-- Logs begin at Tue 2022-07-05 19:55:56 UTC, end at Tue 2022-07-05 21:15:52 UTC. -- Jul 05 20:40:21.072178 dv-cinder-797608-49-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 20:40:21 2022] *** Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: nodename: dv-cinder-797608-49-iscsi Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: machine: x86_64 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: clock source: unix Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: pcre jit disabled Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: detected number of CPU cores: 4 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: current working directory: / Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: detected binary path: /usr/bin/uwsgi-core Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: your processes number limit is 47680 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: your memory page size is 4096 bytes Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: detected max file descriptor number: 2048 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: lock engine: pthread robust mutexes Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: thunder lock: enabled Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 20:40:21.086211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 20:40:21.127598 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: Python main interpreter initialized at 0x56220bcb09c0 Jul 05 20:40:21.127598 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: python threads support enabled Jul 05 20:40:21.127598 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: your server socket listen backlog is limited to 100 connections Jul 05 20:40:21.127598 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: your mercy for graceful operations on workers is 90 seconds Jul 05 20:40:21.127960 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 20:40:21.128035 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: *** Operational MODE: preforking *** Jul 05 20:40:21.128285 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: *** uWSGI is running in multiple interpreter mode *** Jul 05 20:40:21.128285 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: spawned uWSGI master process (pid: 80139) Jul 05 20:40:21.128492 dv-cinder-797608-49-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 05 20:40:21.133211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: spawned uWSGI worker 1 (pid: 80151, cores: 1) Jul 05 20:40:21.133211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: spawned uWSGI worker 2 (pid: 80152, cores: 1) Jul 05 20:40:21.133211 dv-cinder-797608-49-iscsi devstack@keystone.service[80139]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 20:40:26.577542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:40:26.577542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: from cryptography.utils import int_from_bytes Jul 05 20:40:26.578363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:40:26.578363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: from cryptography.utils import int_from_bytes Jul 05 20:40:26.578815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:40:26.578815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: from cryptography.utils import int_from_bytes Jul 05 20:40:26.578942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:40:26.578942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: from cryptography.utils import int_from_bytes Jul 05 20:40:26.627220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:40:26.627393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:40:26.627478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:40:26.627564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:40:26.627640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] command line args: [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:40:26.627717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] command line args: [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:40:26.627879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:40:26.627967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:40:26.628041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ================================================================================ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:40:26.628117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ================================================================================ {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:40:26.628294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] admin_token = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.628375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] admin_token = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.628535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] config_dir = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.628616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] config_dir = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.628721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.628801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.628903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] config_source = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] config_source = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] debug = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] debug = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.629932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.630041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.630143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.630755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.630860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_config_append = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_config_append = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.631916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_dir = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_dir = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_file = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.632961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.633938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.634949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] publish_errors = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] publish_errors = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.635963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.636944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] standard_threads = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] standard_threads = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] use_journal = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] use_journal = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] use_json = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.637952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] use_json = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] use_stderr = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] use_stderr = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] use_syslog = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] use_syslog = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:40:26.638678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.638763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.638910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.638996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.639960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.640911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.641897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.642848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.643808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.644887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.645846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.646551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.646677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.646788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.646906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.647922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.648914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.649854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.650934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.651946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.652886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.653988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.654936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.655982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.656916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.657880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.658950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.659995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.660921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.661926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.662985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.663149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.663489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.663664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.663743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.663901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.663980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.external = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.external = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664591 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.664980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.password = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.password = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] auth.token = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] auth.token = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.665891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.666974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.667923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.668878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.669907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670429 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.670928 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.671964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.672889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.673861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.674931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.675930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.676866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.677950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.678956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.679869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.680972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.681923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.682917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.683994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.684914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.685954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.686870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.687969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.688984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.689948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.690880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.691976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.692056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.692212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.692292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.692446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.692528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.692677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.693277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.693469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.693611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.693749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.693888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.693996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694147 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.694936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.695873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.696818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] role.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.697933 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] role.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] role.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] role.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.698966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.699939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.700895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.701937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.702985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.703962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.704866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.705995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.706995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.707940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.708097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.708178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.708334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.708442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.709970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.710908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.connection = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.711908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.712995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.713921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.714926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.715081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.715159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.715309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.715396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.715472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:40:26.715545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:40:26.715693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:40:26.746082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.746243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.746341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.746421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.746518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.746603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.754808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.754985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.784404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.784538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.784623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.784762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.928418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.928597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.977336 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.977512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.977628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:26.977749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.042966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.043085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.043169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.068479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.068628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.068736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.068821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.068894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.069882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.080803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.080900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.094951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.095078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.095162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.095288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.095372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.095499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:40:27.112610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.112763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.112849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:40:27.113015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:40:27.113240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.113353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.113437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:40:27.113553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:40:27.113692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.113822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.113949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.114080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.114200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.114333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.114447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.114582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.125865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.125962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.126136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.126221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.126399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.126505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.126675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.126761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.134954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.135098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.138225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.138411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.138496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.138687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.138768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.138965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.139848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.140887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.168235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.168335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.169916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.170003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.170194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.170280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.175410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.175496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.175685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.175769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.176073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.176158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.183967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.184064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.184202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.184295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.188668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.188755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.188962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189046 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.189862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.190043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.190136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.190304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.190386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.190559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.190649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.209659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.209757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.209947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.210090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.214550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.214687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.218236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.218410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.218552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.218700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.223642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.224092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.227418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.227845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.231067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.231364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.231498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.231657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.231787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.231946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.232087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.232228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.232356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.232511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.232641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.232777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.252217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.252369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.252500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.252628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.252767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.252909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.253069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.253197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.261481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.261710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.263159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.263326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.263465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.263596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.266597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.266745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.266916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.267899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.280994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.281174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.281307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.281455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.281585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.281715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.281852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.281981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.282109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.282237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.283610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.283750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.283906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.284049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.301917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.302643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.305892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.306101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.309194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.309458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.310923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.311191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.312545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.312817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.312988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.313120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.313248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.313387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.320703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.322334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.322884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.324493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.325576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.325863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.326249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.326523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.327729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.328013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.328398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.328672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.335749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.336027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.336302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.337780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.338061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.338332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.344224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.344501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.344779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.345081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.345354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.345747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:40:27.346293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.346969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.347954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.348112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.348252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.348510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.348782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.349597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.349865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.350127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:40:27.386316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56220bcb09c0 pid: 80152 (default app) Jul 05 20:40:27.388907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56220bcb09c0 pid: 80151 (default app) Jul 05 20:40:27.389712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efb1c3-41a3-4de3-bba5-9b75a8da9563 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:27.390011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efb1c3-41a3-4de3-bba5-9b75a8da9563 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:27.390290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efb1c3-41a3-4de3-bba5-9b75a8da9563 None None] PATH_INFO: `/v3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:27.394486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Jul 5 20:40:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:35.113656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:35.114226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:35.114226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:35.119596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:35.124748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:35.125204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:35.125327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:35.194437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: INFO dbcounter [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] Registered counter for database keystone Jul 05 20:40:35.215826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG oslo_db.sqlalchemy.engines [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:40:35.222016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writer thread running {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:40:35.405368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG passlib.handlers.bcrypt [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80152) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 20:40:35.405655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG passlib.handlers.bcrypt [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80152) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 20:40:35.462490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:35.464159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:35.600781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 20:40:35.764093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:35.835421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: INFO dbcounter [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] Registered counter for database keystone Jul 05 20:40:35.854500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG oslo_db.sqlalchemy.engines [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:40:35.860595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writer thread running {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:40:35.979722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598d009-dec3-45c6-b144-bcb54acb8c0e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:35.984000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:35.984656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:35.984953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:35.985245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:35.993546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:36.045575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 20:40:36.045917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8675019-54d6-49df-bc91-3fea60a5ced4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:36.055566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jul 5 20:40:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:40:36.061657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:36.076071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc18b8-dd61-4730-947e-a090ce832ca8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:36.080535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:36.081691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:36.081979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:36.082255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] PATH_INFO: `/v3/projects/bc03931f4286458d988d48dd2cd6c224` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:36.084377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] RBAC: Authorizing `identity:get_project(project_id=bc03931f4286458d988d48dd2cd6c224)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:36.137166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 20:40:36.137731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555c8fd-37be-4f36-a418-041917b69ff1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:36.142100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Jul 5 20:40:36 2022] GET /identity/v3/projects/bc03931f4286458d988d48dd2cd6c224 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:38.247858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bd0e3-39ab-40bd-a503-a43f9ee318fa None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:38.248370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bd0e3-39ab-40bd-a503-a43f9ee318fa None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:38.248370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bd0e3-39ab-40bd-a503-a43f9ee318fa None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:38.252478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:40:38.258149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:38.258529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:38.258715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:38.277636 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:38.279171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:38.287627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 20:40:38.309836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bd0e3-39ab-40bd-a503-a43f9ee318fa None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:38.321609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bd0e3-39ab-40bd-a503-a43f9ee318fa None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:38.325724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21724-b49c-40d5-ab9e-d684f4a510c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:38.326345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21724-b49c-40d5-ab9e-d684f4a510c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:38.326627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21724-b49c-40d5-ab9e-d684f4a510c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:38.326898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21724-b49c-40d5-ab9e-d684f4a510c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:38.334989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b21724-b49c-40d5-ab9e-d684f4a510c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:38.336761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b21724-b49c-40d5-ab9e-d684f4a510c6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:38.345428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jul 5 20:40:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:40:38.350961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:38.359987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825890-2394-42b2-9f2e-8c8ccbc794d9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:38.364344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd4660-c12b-4583-bc91-54bc93bb33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:38.365736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd4660-c12b-4583-bc91-54bc93bb33f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:38.366020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd4660-c12b-4583-bc91-54bc93bb33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:38.366298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd4660-c12b-4583-bc91-54bc93bb33f0 admin admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:38.367700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd4660-c12b-4583-bc91-54bc93bb33f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:38.369571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd4660-c12b-4583-bc91-54bc93bb33f0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:38.371127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Jul 5 20:40:38 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:40.469003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a435a-6472-4e80-bcb0-43913c7a232b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.469520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a435a-6472-4e80-bcb0-43913c7a232b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.469605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a435a-6472-4e80-bcb0-43913c7a232b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.470892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:40.476150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.476559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.476654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7ed0-87a7-438b-8c7a-c9450e6f65c1 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.476737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.476855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7ed0-87a7-438b-8c7a-c9450e6f65c1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.477165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab7ed0-87a7-438b-8c7a-c9450e6f65c1 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.478561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:40:40.483130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.483413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.483694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.494297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:40.495498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:40.524549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG passlib.handlers.bcrypt [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80151) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 20:40:40.524985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG passlib.handlers.bcrypt [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80151) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 20:40:40.576155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:40.577784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:40.579309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:40.603340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:40.626890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:40.676665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:40.699926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:40.707757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5f52a-771a-4697-b98f-4eb9f528a455 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:40.742308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:40.743040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.743327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.743720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.757839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:40.769439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:40.770457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:40:40.771363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:40:40.776717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:40.806461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82159ebe-b7ce-4a74-8765-5b3ce5fabc45 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:40.808847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:40.845756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:40.846656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.846945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.847223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.861464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:40.880966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22bcc-430e-4ca5-889f-632b0707169d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:40.914503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:40.914835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:40.915170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.915457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.915738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.916377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:40.916494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:40.916805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:40.918238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:40.929964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:40.935556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:41.012479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:40:41.017935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:41.020716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:41.037572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c9a23-bb2a-47ae-97a4-e2c67cb43ef6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:41.070550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:41.071496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:41.071774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:41.072042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:41.073260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:41.074723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:41.076640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:40 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:41.081695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:41.097109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:41.118560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee6e8-7f1c-47b4-a65d-21915a47c71f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:41.151632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:41.152424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:41.152700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:41.152997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:41.171965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:41.173502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:41.182950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767f235-5eea-468e-87b2-7af231c8a853 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:40:41.194542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:41.195345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:41.196148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:40:41.196148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:40:41.196148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:40:41.196148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:40:41.196148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:40:41.201503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:41.220731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:41.221553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:41.221839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:41.222117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:41.223311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:41.225338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:41.226934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:41.232938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:41.258539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:41.305175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d551de9-254f-48db-8d27-a542751f5b1a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:41.313716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:41.334983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4208-9c19-4dee-8823-b8f79b9386a0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:41.339785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:41.340446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:41.340755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:41.341074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:41.341800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:41.342108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:41.343506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af129-c822-4c22-8073-b12dd9929ee8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:41.361311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:41.371069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:41.371893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:41.372246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:41.372597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:41.373566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.domain.id=default, user.id=52d40fe0347f4d97acf889a2462a0c46) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:41.373949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:41.375518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f73a9e-62e1-4ab4-a34a-fc687bf28b6b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:41.383992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jul 5 20:40:41 2022] GET /identity/v3/role_assignments?user.id=52d40fe0347f4d97acf889a2462a0c46&scope.domain.id=default&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:43.711249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051dc51-0250-4f70-b2f4-3df69eface04 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:43.711761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051dc51-0250-4f70-b2f4-3df69eface04 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:43.711836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051dc51-0250-4f70-b2f4-3df69eface04 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:43.713260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:43.718834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:43.719244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:43.719417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:43.745941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:43.747531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:43.859950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:43.902586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051dc51-0250-4f70-b2f4-3df69eface04 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:44.053687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051dc51-0250-4f70-b2f4-3df69eface04 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:44.080151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:44.101633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:44.102444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.102730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.103011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.114815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:44.116765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-5847fc5b-445a-432e-825d-e6b70ee7c99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:40:44.143847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:44.144710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:44.145680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:40:44.145680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:40:44.145680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:40:44.145680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:40:44.149347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 12/24] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:44.155009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:44.218868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458107b9-9357-4e0c-92dd-95323444c5c0 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.219186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458107b9-9357-4e0c-92dd-95323444c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.219426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458107b9-9357-4e0c-92dd-95323444c5c0 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.220965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 13/25] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:44.226064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75a0c9-b812-4377-8bc8-fca8b9a041c8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.226350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75a0c9-b812-4377-8bc8-fca8b9a041c8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.226630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75a0c9-b812-4377-8bc8-fca8b9a041c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.258004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ae75a0c9-b812-4377-8bc8-fca8b9a041c8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:44.259255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ae75a0c9-b812-4377-8bc8-fca8b9a041c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:44.334979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:44.362917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338a5c2-a20a-43b3-a7b8-9e92e6fb1213 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:44.399941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:44.401051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.401568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.402045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.402981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:44.403483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:44.405114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:44.407269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:44.414312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c0c5-cf88-43bd-88ff-a670a199fbe3 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.414785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c0c5-cf88-43bd-88ff-a670a199fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.415210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c0c5-cf88-43bd-88ff-a670a199fbe3 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.416753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 15/27] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:44.421990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.422449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.422869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.426026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 13/28] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:44.431919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:44.465491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:44.467437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:44.541846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 16/29] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:44.542694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:44.557108 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec3112-b2a2-4095-88f2-1fec8ecd9a89 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:44.573342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:44.594683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:44.595586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.596014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.596435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.597380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:44.599597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:44.603715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:44.662513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcadd6f-3645-494b-acca-2407af75cf3f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:44.698445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30a4ec-eb74-4821-ac32-0fbcb5cfa03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:44.699253 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30a4ec-eb74-4821-ac32-0fbcb5cfa03f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.699535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30a4ec-eb74-4821-ac32-0fbcb5cfa03f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.699817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30a4ec-eb74-4821-ac32-0fbcb5cfa03f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.712907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30a4ec-eb74-4821-ac32-0fbcb5cfa03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-de30a4ec-eb74-4821-ac32-0fbcb5cfa03f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:44.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:44.722957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:40:44.724367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 17/30] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:44.725221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2f25-e28c-42c6-812e-c257baf4eef7 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.725712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2f25-e28c-42c6-812e-c257baf4eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.725712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2f25-e28c-42c6-812e-c257baf4eef7 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.727000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 18/31] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:44.731274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2f25-e28c-42c6-812e-c257baf4eef7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:44.761808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 14/32] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:40:44 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:44.763585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:44.846082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:44.870720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2f25-e28c-42c6-812e-c257baf4eef7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:44.934917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088a569-a1bf-4aa1-a229-ef2270ab2be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:44.936029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088a569-a1bf-4aa1-a229-ef2270ab2be2 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:44.936520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088a569-a1bf-4aa1-a229-ef2270ab2be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:44.937031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088a569-a1bf-4aa1-a229-ef2270ab2be2 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:44.937997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088a569-a1bf-4aa1-a229-ef2270ab2be2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:44.939665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088a569-a1bf-4aa1-a229-ef2270ab2be2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:44.988266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c399a-9f9e-4525-991a-8eaea5cc9935 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.028428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.029148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.029443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.029726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.030558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:45.030875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.032449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454cf06-0eae-4732-a99a-5b3c9a026f12 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.042059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 15/33] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:45.043463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da477-9664-4e97-8b61-4ee43212705e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.043760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da477-9664-4e97-8b61-4ee43212705e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.044047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da477-9664-4e97-8b61-4ee43212705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.061775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ff4da477-9664-4e97-8b61-4ee43212705e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:45.063336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ff4da477-9664-4e97-8b61-4ee43212705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:45.093578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 5 20:40:44 2022] POST /identity/v3/roles => generated 225 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:45.095774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6337828-ff52-42a2-9f62-50d51e1bb8c2 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.096339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6337828-ff52-42a2-9f62-50d51e1bb8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.096881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6337828-ff52-42a2-9f62-50d51e1bb8c2 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.099980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 20/35] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:45.100872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6337828-ff52-42a2-9f62-50d51e1bb8c2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.110959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.151643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 16/36] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:45.153036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.153338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.153736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.172859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:45.174196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:45.255850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:45.256724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.258536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6337828-ff52-42a2-9f62-50d51e1bb8c2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.307056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.307982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.308271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.308550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.310416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.312061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.313910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 21/38] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:45 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:45.314711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.343783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.431437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17235-2887-4c3f-916c-85b36dc91628 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.464616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.465319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.465611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.465886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.466635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.468032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.475120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797f462-53aa-4d52-aa6f-de610f46bcd2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.482239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 22/39] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:45.482952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.500465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.532324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082420-c2f7-4751-a981-c5ec0454a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.533457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082420-c2f7-4751-a981-c5ec0454a6f4 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.533757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082420-c2f7-4751-a981-c5ec0454a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.534039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082420-c2f7-4751-a981-c5ec0454a6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.535181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082420-c2f7-4751-a981-c5ec0454a6f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.537593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082420-c2f7-4751-a981-c5ec0454a6f4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.555117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 18/40] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/roles => generated 219 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:45.556383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826681b-89e7-48dd-9f7a-f7e3462f06d9 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.556675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826681b-89e7-48dd-9f7a-f7e3462f06d9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.556980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826681b-89e7-48dd-9f7a-f7e3462f06d9 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.558515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 19/41] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:45.564361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.564706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.564954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.585985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:45.587283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:45.593979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.630920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba093-ce6b-4706-874e-07873bdab07b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.683145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.684009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.684297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.684577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.686110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.687742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.693028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 23/42] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:45.696090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.702240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 20/43] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:45.727628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.817188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180684c-651d-4ae1-909b-70efa512d655 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.836199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.840464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a79ef-7d0e-4941-a01e-c60b1545de8f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.851041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.851920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.852204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.852478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] PATH_INFO: `/v3/domains/default/users/52d40fe0347f4d97acf889a2462a0c46/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.854581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=52d40fe0347f4d97acf889a2462a0c46, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.856054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.870573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Jul 5 20:40:45 2022] PUT /identity/v3/domains/default/users/52d40fe0347f4d97acf889a2462a0c46/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:40:45.877335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850614-2920-40b0-92b8-46aab6332e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.878166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850614-2920-40b0-92b8-46aab6332e27 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.878452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850614-2920-40b0-92b8-46aab6332e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.878733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850614-2920-40b0-92b8-46aab6332e27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.880789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec850614-2920-40b0-92b8-46aab6332e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.882501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec850614-2920-40b0-92b8-46aab6332e27 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.884254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 21/45] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:45.890106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.894130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:46.107331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42511f-d84a-4f6b-8454-16256b36a6d5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:46.142339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d745b4-4d46-4e54-82a0-e1b714d20bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:46.143014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d745b4-4d46-4e54-82a0-e1b714d20bd6 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:46.143302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d745b4-4d46-4e54-82a0-e1b714d20bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:46.143583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d745b4-4d46-4e54-82a0-e1b714d20bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:46.144290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d745b4-4d46-4e54-82a0-e1b714d20bd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:46.146371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d745b4-4d46-4e54-82a0-e1b714d20bd6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:46.172721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/projects => generated 312 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:47.950719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80d85-aca8-439c-a060-1f8f31761f1b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:47.951228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80d85-aca8-439c-a060-1f8f31761f1b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:47.951336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80d85-aca8-439c-a060-1f8f31761f1b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:47.952822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 22/47] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:47.958707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781509b-b180-44cf-9eb3-f9e2fd2d99ba None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:47.959119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781509b-b180-44cf-9eb3-f9e2fd2d99ba None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:47.959381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781509b-b180-44cf-9eb3-f9e2fd2d99ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:47.976887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6781509b-b180-44cf-9eb3-f9e2fd2d99ba None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:47.978439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6781509b-b180-44cf-9eb3-f9e2fd2d99ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:48.028761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.047752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:48.070844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80d85-aca8-439c-a060-1f8f31761f1b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.175434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80d85-aca8-439c-a060-1f8f31761f1b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.215475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.216274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.216560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.216855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.227080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:48.234758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:48.235601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:40:48.236482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 23/49] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:48.237256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebee0c-4738-4c13-b638-f812526ff1f2 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.237256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebee0c-4738-4c13-b638-f812526ff1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.237376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebee0c-4738-4c13-b638-f812526ff1f2 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.238693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 27/50] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:48.242019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.244095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.244472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.244729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.261690 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:48.262896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:48.270681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.329406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 28/51] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:48.343337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f043-1d3f-4301-92e4-c976a13c4cb2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.353157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.377486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.378157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.378441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.378716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.379464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:48.379770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.381384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.389236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 24/52] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:48.394765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.453618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd113b-ab17-4860-b4c5-e746dcf1ffc5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.470070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.484795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.493197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.494112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.494277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.494552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.496521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.497923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deda13-75cf-4f1c-8170-99fc8063eac7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.498144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.500356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 29/53] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:48.508458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.533345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.534227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.534513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.534796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.536005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.537526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.543669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 25/54] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:48.544775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.612710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697734a-b0ed-4a0b-adac-beca4111dd7c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.643997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43302cd7-777c-4ca7-a570-e39186dd1623 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.646733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.647384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.647666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.647934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.648632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.650400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.676983 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 30/55] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jul 5 20:40:48 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:40:48.685146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636b7ba-e194-43e1-8c6a-e47f229c319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.685994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b7ba-e194-43e1-8c6a-e47f229c319b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.686268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b7ba-e194-43e1-8c6a-e47f229c319b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.686544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636b7ba-e194-43e1-8c6a-e47f229c319b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.687796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b7ba-e194-43e1-8c6a-e47f229c319b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.689326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636b7ba-e194-43e1-8c6a-e47f229c319b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.691030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 26/56] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:40:48.697432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.735279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.809134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6abe22-7182-40ac-869a-3608cc1ecd9f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.852683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.853423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.853707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.853981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.854817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.domain.id=default, user.id=52d40fe0347f4d97acf889a2462a0c46) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:48.855127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.856569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002bddd-830e-4213-b733-fd6207967419 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.865230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 31/57] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/role_assignments?user.id=52d40fe0347f4d97acf889a2462a0c46&scope.domain.id=default&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:50.753162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e7e2-c1c9-4a65-b0b5-01ee9d7773d1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:50.753682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e7e2-c1c9-4a65-b0b5-01ee9d7773d1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:50.753766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e7e2-c1c9-4a65-b0b5-01ee9d7773d1 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:50.755632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 27/58] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:50.760826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:50.761262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:50.761422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:50.779095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:50.780294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:50.845997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:50.871469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e7e2-c1c9-4a65-b0b5-01ee9d7773d1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:50.896752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:50.972347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e7e2-c1c9-4a65-b0b5-01ee9d7773d1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:51.004987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb18578-7dcb-4158-b8de-93fb7a3d2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:51.005763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18578-7dcb-4158-b8de-93fb7a3d2656 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:51.006053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18578-7dcb-4158-b8de-93fb7a3d2656 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:51.006329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18578-7dcb-4158-b8de-93fb7a3d2656 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:51.007498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb18578-7dcb-4158-b8de-93fb7a3d2656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:51.008957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb18578-7dcb-4158-b8de-93fb7a3d2656 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:51.010555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 28/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:51.015957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:51.046137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:51.113607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6320fa-01fd-460a-be35-d29cf7aed664 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:51.146388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd92d55-c2c0-42cd-a0a7-053e39fa89fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:51.147133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92d55-c2c0-42cd-a0a7-053e39fa89fd None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:51.147420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92d55-c2c0-42cd-a0a7-053e39fa89fd None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:51.147700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92d55-c2c0-42cd-a0a7-053e39fa89fd None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:51.148399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92d55-c2c0-42cd-a0a7-053e39fa89fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:51.149895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92d55-c2c0-42cd-a0a7-053e39fa89fd None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:51.175008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 33/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:40:51 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:54.411130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184c15-4fe1-49ec-80fd-36bc7f765c1a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.411130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184c15-4fe1-49ec-80fd-36bc7f765c1a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.411130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184c15-4fe1-49ec-80fd-36bc7f765c1a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.411130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 29/62] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:54.413956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cb50e-f5c4-4ca4-a15e-06ef2199506e None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.414792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cb50e-f5c4-4ca4-a15e-06ef2199506e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.415278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cb50e-f5c4-4ca4-a15e-06ef2199506e None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.416788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa402e-b84e-4dba-8ff9-a3a53a461f70 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.416985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 34/63] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:54.417286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa402e-b84e-4dba-8ff9-a3a53a461f70 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.417777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa402e-b84e-4dba-8ff9-a3a53a461f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.422065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a018-7ef3-44b2-b917-d29ceec70712 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.422358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a018-7ef3-44b2-b917-d29ceec70712 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.422637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a018-7ef3-44b2-b917-d29ceec70712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.438207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-55aa402e-b84e-4dba-8ff9-a3a53a461f70 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:54.440326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-55aa402e-b84e-4dba-8ff9-a3a53a461f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.452940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-eac8a018-7ef3-44b2-b917-d29ceec70712 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:54.452940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-eac8a018-7ef3-44b2-b917-d29ceec70712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.550363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:54.578559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1d21b-60c5-4710-ac7a-2c67c8a562f0 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.579216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1d21b-60c5-4710-ac7a-2c67c8a562f0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.579699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1d21b-60c5-4710-ac7a-2c67c8a562f0 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.581656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 31/65] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:54.590919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836b56-c7cb-4c84-a7f3-c94c1e8a884e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.591431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836b56-c7cb-4c84-a7f3-c94c1e8a884e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.591565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf836b56-c7cb-4c84-a7f3-c94c1e8a884e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.592566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:40:54.592885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 32/67] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:40:54.593727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf836b56-c7cb-4c84-a7f3-c94c1e8a884e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:54.593995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430245e-229a-49f2-a1ac-70558c6eb188 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.594501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430245e-229a-49f2-a1ac-70558c6eb188 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.594923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430245e-229a-49f2-a1ac-70558c6eb188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.616013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9430245e-229a-49f2-a1ac-70558c6eb188 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:54.617238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9430245e-229a-49f2-a1ac-70558c6eb188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.624240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:54.628550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:54.697813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 36/68] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:54.699516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.699801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.700085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.722124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf836b56-c7cb-4c84-a7f3-c94c1e8a884e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:54.728301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:54.729564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.763282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:54.764357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.765395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.765395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.777576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:54.785502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:54.786998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:40:54.787900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 33/69] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:54.788786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:54.811348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 37/70] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:54.812395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:54.880368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:54.900151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb7334-8172-4ff5-9f0d-d2b6272da519 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:54.906725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:54.932746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55efb68-904b-4eef-afe3-2fba415c0c1d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:54.938223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:54.939049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.939338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.939618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.952188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:54.959970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:54.960821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:40:54.961650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 34/71] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:54.962276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:54.973589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:54.974464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.974755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.975036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.985696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:54.994047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:54.994891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 38/72] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:40:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:54.997629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.079245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9df1f-78dd-4cfe-bf01-c0997219bca6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.109315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f9b3a-8f74-4232-b93d-5c4743448e1d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.114901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.115584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.115876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.116159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.116916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:55.117303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.118812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.133356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 35/73] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.133356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.138499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.144836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.146810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.147097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.147372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.151157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.160902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:40:55.168857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:40:55.169728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:40:55.170509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 39/74] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:40:55.171167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.245368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fc7ec-e842-4ab9-923e-e1c6176bc4e1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.273771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e99f0-bbe4-4256-afd0-ca908807d76e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.278154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.278820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.279106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.279383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.280126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:55.280442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.281844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.290526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 36/75] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.291313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.308712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.309420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.309705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.310012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.310780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:55.311085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.312478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.325418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.326529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.364756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.386435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.401064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c28af-f2e8-47b0-b982-cff4bcfcb617 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.430775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef9dd1-d300-48ca-aa62-241b3a9d4076 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.436207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f42e0-3d64-4610-a1bc-3cfbcbfa628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.437122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f42e0-3d64-4610-a1bc-3cfbcbfa628f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.437420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f42e0-3d64-4610-a1bc-3cfbcbfa628f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.438102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f42e0-3d64-4610-a1bc-3cfbcbfa628f None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.453574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f42e0-3d64-4610-a1bc-3cfbcbfa628f None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.455061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f42e0-3d64-4610-a1bc-3cfbcbfa628f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.456732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 37/77] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.458603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8730-a487-47cc-9132-0d10d3fc7310 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.458893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8730-a487-47cc-9132-0d10d3fc7310 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.459174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8730-a487-47cc-9132-0d10d3fc7310 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.460960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 38/78] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:55.461170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d8730-a487-47cc-9132-0d10d3fc7310 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.468121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.468800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.469120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.469404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.470160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:55.470468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.471866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.480029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 41/79] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.480812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.562349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d8730-a487-47cc-9132-0d10d3fc7310 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.581897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1dc44-8163-4e48-879c-a639320495fc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.586719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.597847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.598761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.599125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.599419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.600627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.601437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.602128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.603766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 39/80] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.604542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.620386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445de5-955d-4677-9c16-84bd97c82fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.621303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445de5-955d-4677-9c16-84bd97c82fab None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.621582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445de5-955d-4677-9c16-84bd97c82fab None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.621853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445de5-955d-4677-9c16-84bd97c82fab None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.623078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445de5-955d-4677-9c16-84bd97c82fab None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.624531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445de5-955d-4677-9c16-84bd97c82fab None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.626202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.627421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.627710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.627986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.644558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:55.645922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:55.713784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 43/82] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:55.714020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e33218-b613-49a9-8bd4-6addc37e8be3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.714614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.749225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.749881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.750171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.750447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.810390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.821098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.822500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.828860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4ae4c-8f11-4a88-93c8-338076876f6f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:55.845596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:55.862533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:55.863409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:55.863688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:55.863960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:55.865237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:55.866672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:55.868286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 44/83] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:55.869061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.922024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 40/84] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:40:55.922872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:55.976525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79748919-bcc6-4008-b71b-9548f2efdf49 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.009765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.010415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.010700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.010975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.018207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.028047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb06aa-c55b-412c-bc14-e57c911167d4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.061558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.062207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.062492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.062768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.064718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.078798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.080213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.131447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.132965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.180444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 45/85] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:40:56.181394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.226659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.236264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 41/86] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:40:56.237113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.272052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.287400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179b21-1355-4cfa-a9fd-5c40d9fff8a8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.320691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.321512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.321800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.322076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.323261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.324732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.326556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 46/87] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:56.327158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.337822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bc67a-1d89-43aa-b987-3c01dd818429 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.375836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.376491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.376780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.377098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.425040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6bb8-5aa0-4864-8234-d09d9c6ea82d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.435682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.445192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.446667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.460751 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.461637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.461922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.462208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.463396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.464836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.466563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 47/88] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:56.467325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.492042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.548711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 42/89] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:40:56.549595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.568514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde6ba9-19e3-4391-b4c5-c405afcdfd0e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.601992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.602787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.603076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.603356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.604537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.606037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.607740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 48/90] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:56.608480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.643240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.652396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db43dfb-1109-4ea9-a14c-deff2b79c060 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.687439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.688304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.688589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.688867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.690114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.691567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.693476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 43/91] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:56.694240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.701143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.711116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb5c3-6e9a-43ce-94fe-e1991de3963d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.745025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.745691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.745974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.746251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.746957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.748422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.771018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 49/92] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:40:56 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:40:56.771953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.799287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8965-faa1-4f0a-9ac5-d3bbf15a9772 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.839403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.840082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.840383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.840654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.841544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=013b61df053d44f4935205044229122a, user.id=85b501a53389476b8ec65a6de4cce2e1) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:56.841861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.843349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.849904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 44/93] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/role_assignments?user.id=85b501a53389476b8ec65a6de4cce2e1&scope.project.id=013b61df053d44f4935205044229122a&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:56.851137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.885151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:56.912082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f87d47-3609-4c3d-a2ce-2b6ce548f679 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:56.958461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:56.959731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:56.960022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:56.960302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] PATH_INFO: `/v3/projects/b57f2a8c772a4abc84de91a2c335e19f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:56.961658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] RBAC: Authorizing `identity:get_project(project_id=b57f2a8c772a4abc84de91a2c335e19f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:56.963171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:56.964964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 50/94] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/projects/b57f2a8c772a4abc84de91a2c335e19f => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:56.966502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:56.988205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:57.002523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056a983-9302-463b-a586-c4acedb35c35 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:57.046925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:57.047728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:57.048010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:57.048285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:57.049175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=013b61df053d44f4935205044229122a, user.id=52d40fe0347f4d97acf889a2462a0c46) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:57.049492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:57.051057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:57.060715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 45/95] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/role_assignments?user.id=52d40fe0347f4d97acf889a2462a0c46&scope.project.id=013b61df053d44f4935205044229122a&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:57.061606 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:57.101305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32c291-981b-496a-951f-a4213f2bbbad None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:57.160322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:57.161361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:57.161769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:57.162056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:57.162927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] RBAC: Adding query filter params (role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=013b61df053d44f4935205044229122a, user.id=85b501a53389476b8ec65a6de4cce2e1) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:57.163240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:57.166052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf273-49a9-466c-8b45-f2df3852bfd6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:57.182320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 51/96] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:40:56 2022] GET /identity/v3/role_assignments?user.id=85b501a53389476b8ec65a6de4cce2e1&scope.project.id=013b61df053d44f4935205044229122a&role.id=ce695803124649b4ad62ca6ec15c935e => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:57.193660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:57.212875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a9cf3-0099-4558-9209-2d84a084aac5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:57.261765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:57.262459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:57.262752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:57.263037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:57.263908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=b57f2a8c772a4abc84de91a2c335e19f, user.id=85b501a53389476b8ec65a6de4cce2e1) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:40:57.264229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:57.265797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6cf03-d399-4aeb-95db-78af403102a9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:57.277029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 46/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:40:57 2022] GET /identity/v3/role_assignments?user.id=85b501a53389476b8ec65a6de4cce2e1&scope.project.id=b57f2a8c772a4abc84de91a2c335e19f&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:40:59.754303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3ed5-a65f-4c82-b46e-e39c65f7321d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:59.755716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3ed5-a65f-4c82-b46e-e39c65f7321d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:59.755716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3ed5-a65f-4c82-b46e-e39c65f7321d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:59.757064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 52/98] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:59.764272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309a40-ed45-4ea8-a5ac-245ac969b8f8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:59.764708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309a40-ed45-4ea8-a5ac-245ac969b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:59.764894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309a40-ed45-4ea8-a5ac-245ac969b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:59.789975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-69309a40-ed45-4ea8-a5ac-245ac969b8f8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:59.791211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-69309a40-ed45-4ea8-a5ac-245ac969b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:59.884890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 47/99] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:40:59.912736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3ed5-a65f-4c82-b46e-e39c65f7321d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:59.979212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f198-5410-4a25-b361-0dc45f0b4a4a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:59.979530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f198-5410-4a25-b361-0dc45f0b4a4a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:59.979785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1f198-5410-4a25-b361-0dc45f0b4a4a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:59.981465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 48/100] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:59.991071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4fec-35bf-4c13-85d3-d3f0bfc5850d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:59.991369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4fec-35bf-4c13-85d3-d3f0bfc5850d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:59.991666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4fec-35bf-4c13-85d3-d3f0bfc5850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.022287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0a7a4fec-35bf-4c13-85d3-d3f0bfc5850d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:00.023437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0a7a4fec-35bf-4c13-85d3-d3f0bfc5850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:00.053379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.073620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3ed5-a65f-4c82-b46e-e39c65f7321d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.128690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:00.136027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.136844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.137241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.137524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.157828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:00.160707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5050-91eb-4fe0-a2b9-472e7fc15e12 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.161111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5050-91eb-4fe0-a2b9-472e7fc15e12 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.161474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5050-91eb-4fe0-a2b9-472e7fc15e12 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.162962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 50/102] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:00.168257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.168548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.168860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:00.184406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:00.185335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:00.186788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 53/103] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:40:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:00.189138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.193723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:00.194926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:00.211184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.293563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:00.294446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.308948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d697bc-4391-4f50-b19a-92acaa17c671 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.343884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7cfe5-d519-4d48-b951-2fd66e85de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.344686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7cfe5-d519-4d48-b951-2fd66e85de69 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.344989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7cfe5-d519-4d48-b951-2fd66e85de69 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.345316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7cfe5-d519-4d48-b951-2fd66e85de69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.353276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.358631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7cfe5-d519-4d48-b951-2fd66e85de69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f5e7cfe5-d519-4d48-b951-2fd66e85de69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:00.366807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:00.367677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:00.368487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:00.373980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19570ed-60e4-42d2-a09a-d48b3b3a4361 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.374259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19570ed-60e4-42d2-a09a-d48b3b3a4361 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.374537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19570ed-60e4-42d2-a09a-d48b3b3a4361 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.375981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 55/106] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:00.376517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19570ed-60e4-42d2-a09a-d48b3b3a4361 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.415122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441a3b8-d18a-4523-b211-53b55895764a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.451586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.452259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.452615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.452817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.453601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:00.454180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:00.455293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc27ef0-a5f5-408d-b4c2-5cebb9b39eb6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:00.465547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 52/107] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:00.470363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71cca4-a318-4424-b995-80874ec36696 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.470656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71cca4-a318-4424-b995-80874ec36696 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.470939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71cca4-a318-4424-b995-80874ec36696 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.472421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 53/108] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:00.472950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71cca4-a318-4424-b995-80874ec36696 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.477876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.494214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19570ed-60e4-42d2-a09a-d48b3b3a4361 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.532534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c75b9f-5338-41ea-bb4d-33f5091b6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.533359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75b9f-5338-41ea-bb4d-33f5091b6432 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.533645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75b9f-5338-41ea-bb4d-33f5091b6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.533922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75b9f-5338-41ea-bb4d-33f5091b6432 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.535085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c75b9f-5338-41ea-bb4d-33f5091b6432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:00.537507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c75b9f-5338-41ea-bb4d-33f5091b6432 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:00.539397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 56/109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:00.540531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf8f47-e90a-4962-ba5a-67943b93e8b6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.540806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf8f47-e90a-4962-ba5a-67943b93e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.541111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf8f47-e90a-4962-ba5a-67943b93e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.557556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8ccf8f47-e90a-4962-ba5a-67943b93e8b6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:00.558697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8ccf8f47-e90a-4962-ba5a-67943b93e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:00.582375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71cca4-a318-4424-b995-80874ec36696 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.617735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.618032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.618433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.618785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.619063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.619857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:00.620196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:00.621713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b6510-eb1b-474d-8f18-1cbd67c1c050 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:00.625845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 57/110] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:00.627122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4503-5e1f-4372-9d7b-148649ea60e3 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.627408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4503-5e1f-4372-9d7b-148649ea60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.627688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f4503-5e1f-4372-9d7b-148649ea60e3 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.628957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 58/111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:00.629696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f4503-5e1f-4372-9d7b-148649ea60e3 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.640609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 54/112] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:00.646032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.646032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.646032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.659629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:00.661370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:00.720204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.728022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:00.741074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.742633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f4503-5e1f-4372-9d7b-148649ea60e3 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.782512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7772cc-0b43-483e-ab24-a10c3ec5401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.783404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7772cc-0b43-483e-ab24-a10c3ec5401d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.783693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7772cc-0b43-483e-ab24-a10c3ec5401d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.783973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7772cc-0b43-483e-ab24-a10c3ec5401d None admin] PATH_INFO: `/v3/users/7e03bfa21ab542bd9c5a8fe91466ff60` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.801060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7772cc-0b43-483e-ab24-a10c3ec5401d None admin] RBAC: Authorizing `identity:get_user(user_id=7e03bfa21ab542bd9c5a8fe91466ff60)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:00.803278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7772cc-0b43-483e-ab24-a10c3ec5401d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:00.804977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 59/114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/users/7e03bfa21ab542bd9c5a8fe91466ff60 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:00.806313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.806610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.806889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.823719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:00.824845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:00.831866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d0d69-59e2-4d5a-b415-19cb278d2f21 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:00.867221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:00.867882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:00.868167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:00.868442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:00.869171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:00.870624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:00.875816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:00.893910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:00.894731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.912960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 56/116] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:41:00 2022] POST /identity/v3/projects => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:00.912960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:00.970292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.010817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae099f-ea22-4ad0-822b-c30296cbaf60 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.028448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae656d-3445-4d9f-accf-3d64571b513b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.050948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.051886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.052171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.052523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.053788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.055262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.056899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 61/117] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:01.057687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.064900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.066031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.066323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.068000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.080797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:01.089048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:01.089943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:01.090788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 57/118] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:01.092137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.123124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.179510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d33e30-205f-4796-aa17-b574ebb4906f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.203984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44bc72-39a2-4669-9251-c3a45d3501b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.213622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.217045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.218177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.218381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.218662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.230441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:01.238264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:01.239425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:01.240519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 62/119] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:01.241317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.248471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.249172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.249465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.249749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.327863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.329732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.348894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bf4b3-5e33-4543-9e87-78fee0dcf80f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.362184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.385004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.385824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.386105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.386378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.399135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:01.407308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:01.408200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:01.409045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:01.414586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 63/120] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:01.415282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.439325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 58/121] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:01.440000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.452452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.533627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff204f7-6362-4668-b01e-ac70cac091a9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.549607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8e74-72e4-4841-a0f5-817cf2eb2f15 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.571116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.571991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.572277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.572556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.573795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.575280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.577180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 64/122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:01.577862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.588960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.588960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.589222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.589440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.590522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:01.590835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.592535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.601765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 59/123] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:01.602491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.623181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.686094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.703311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d6fd-ed42-4718-ba4a-47c605120ba7 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.725376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d717cf-d79c-48b7-9a2a-8f84ab2bcb69 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.747833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.748516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.748801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.749106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.749990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:01.750181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.751557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.759898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 65/124] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:01.764371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.767405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.767405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.767405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.767405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.767716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:01.768598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.770927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.781634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 60/125] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:01.787247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.876267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43512c-4eb9-4bd5-ba6a-485a72ec0dde None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.878119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.895809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160889a-97c5-4fff-8ae9-015dfc4b0554 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.913325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.914490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.914765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.915047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.916257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.917756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.919465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 66/126] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:01.920229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.935411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.942945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.944236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.944792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.945277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a/users/85b501a53389476b8ec65a6de4cce2e1/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.947548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] RBAC: Authorizing `identity:create_grant(project_id=013b61df053d44f4935205044229122a, user_id=85b501a53389476b8ec65a6de4cce2e1, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.949285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.965681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 61/127] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:01 2022] PUT /identity/v3/projects/013b61df053d44f4935205044229122a/users/85b501a53389476b8ec65a6de4cce2e1/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:01.966843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.061053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbec9-7d5f-4369-8d4b-11f28008aa82 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.095018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17bd37-d7ce-434e-aac0-9a534d437efc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.106962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.108184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.108643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.109139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.110861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.112529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.114886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 67/128] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.115898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.133857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.134681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.134963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.135241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.136732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.138320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.144807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 62/129] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.144807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.169259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:02.226680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:02.245430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38478172-7547-40fe-9c8e-5498d3153685 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.274152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf941759-2b48-4670-8edb-303c8f2a6e27 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.283236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.284224 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.284522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.284811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.286718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.288190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.290133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 68/130] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:02 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.290904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.322614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.323286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.323576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.323858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.324705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] RBAC: Adding query filter params (role.id=aeb7208c0c9a4b97ad2ad81d93210437, scope.project.id=013b61df053d44f4935205044229122a, user.id=7e03bfa21ab542bd9c5a8fe91466ff60) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:02.325055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.326535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.332146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 63/131] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:02 2022] GET /identity/v3/role_assignments?user.id=7e03bfa21ab542bd9c5a8fe91466ff60&scope.project.id=013b61df053d44f4935205044229122a&role.id=aeb7208c0c9a4b97ad2ad81d93210437 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.333565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.432420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c311c-9410-48ab-b48c-5630e6408ae5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.441539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:02.475524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.476468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.476761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.477074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.479093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.480588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.482752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 69/132] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:02 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.483603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.558962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb85e4-3fc1-4130-93a6-02f909ee1162 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.596671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:02.618574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.619386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5c338-d616-4fd1-964d-73b2e4ca08f8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.619507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.619745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.620031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] PATH_INFO: `/v3/projects/b57f2a8c772a4abc84de91a2c335e19f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.621354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] RBAC: Authorizing `identity:get_project(project_id=b57f2a8c772a4abc84de91a2c335e19f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.622847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.626273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 64/133] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:02 2022] GET /identity/v3/projects/b57f2a8c772a4abc84de91a2c335e19f => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.627073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.659321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.660456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.661369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.661665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.663504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.665275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.667576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 70/134] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:02 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:02.668324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.725748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:02.798711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950b350-c9f3-4767-a6d4-30a616a68f40 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:02.845763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:02.846731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:02.847018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:02.847299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] PATH_INFO: `/v3/projects/b57f2a8c772a4abc84de91a2c335e19f/users/85b501a53389476b8ec65a6de4cce2e1/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:02.850370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b57f2a8c772a4abc84de91a2c335e19f, user_id=85b501a53389476b8ec65a6de4cce2e1, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:02.851853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:02.869807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 71/135] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:02 2022] PUT /identity/v3/projects/b57f2a8c772a4abc84de91a2c335e19f/users/85b501a53389476b8ec65a6de4cce2e1/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:02.871274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:02.915493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88c58d-eb06-4ecf-ad56-ea594f8efb1b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:03.006564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d9ad7-898b-4c44-ae56-9ab078b531b2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:03.009220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:03.010378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566c945-0d5d-4fbe-b3f9-a0665e2c05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:03.011313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c945-0d5d-4fbe-b3f9-a0665e2c05b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:03.011627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c945-0d5d-4fbe-b3f9-a0665e2c05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:03.011915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566c945-0d5d-4fbe-b3f9-a0665e2c05b7 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a/users/52d40fe0347f4d97acf889a2462a0c46/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:03.018307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566c945-0d5d-4fbe-b3f9-a0665e2c05b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=013b61df053d44f4935205044229122a, user_id=52d40fe0347f4d97acf889a2462a0c46, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:03.019803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566c945-0d5d-4fbe-b3f9-a0665e2c05b7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:03.050762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 65/136] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:02 2022] PUT /identity/v3/projects/013b61df053d44f4935205044229122a/users/52d40fe0347f4d97acf889a2462a0c46/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:03.053210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423957fa-7cad-440a-a9ea-cccc7e09c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:03.054270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423957fa-7cad-440a-a9ea-cccc7e09c392 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:03.054608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423957fa-7cad-440a-a9ea-cccc7e09c392 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:03.054949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423957fa-7cad-440a-a9ea-cccc7e09c392 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a/users/85b501a53389476b8ec65a6de4cce2e1/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:03.057488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423957fa-7cad-440a-a9ea-cccc7e09c392 None admin] RBAC: Authorizing `identity:create_grant(project_id=013b61df053d44f4935205044229122a, user_id=85b501a53389476b8ec65a6de4cce2e1, role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:03.059165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423957fa-7cad-440a-a9ea-cccc7e09c392 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:03.088335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 72/137] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:02 2022] PUT /identity/v3/projects/013b61df053d44f4935205044229122a/users/85b501a53389476b8ec65a6de4cce2e1/roles/ce695803124649b4ad62ca6ec15c935e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:03.323252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616e9b-cde9-4fa5-ace6-119336c02da9 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:03.323657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616e9b-cde9-4fa5-ace6-119336c02da9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:03.323859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616e9b-cde9-4fa5-ace6-119336c02da9 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:03.325444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 66/138] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:03.339656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:03.339971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:03.340204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:03.361990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:03.363209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:03.439751 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 73/139] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:03.477444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616e9b-cde9-4fa5-ace6-119336c02da9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:03.562672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:03.634771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4616e9b-cde9-4fa5-ace6-119336c02da9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:03.684110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604bea3-8767-4929-ba07-c8839a6868eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:03.685322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604bea3-8767-4929-ba07-c8839a6868eb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:03.685811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604bea3-8767-4929-ba07-c8839a6868eb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:03.686316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604bea3-8767-4929-ba07-c8839a6868eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:03.693691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604bea3-8767-4929-ba07-c8839a6868eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:03.698190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604bea3-8767-4929-ba07-c8839a6868eb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:03.701338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 67/140] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:03.706719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:03.834527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:03.844747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ecc0-7640-4889-8bd7-ae4d5deff855 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:03.891692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ef817-31c7-4e34-8e85-73ca5829066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:03.892707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef817-31c7-4e34-8e85-73ca5829066a None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:03.893223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef817-31c7-4e34-8e85-73ca5829066a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:03.893744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ef817-31c7-4e34-8e85-73ca5829066a None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:03.894688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef817-31c7-4e34-8e85-73ca5829066a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:03.897205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ef817-31c7-4e34-8e85-73ca5829066a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:03.926246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 74/141] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:03 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:04.840282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e01036-f329-46c4-8068-2ced6b254d99 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:04.841237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e01036-f329-46c4-8068-2ced6b254d99 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:04.841710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e01036-f329-46c4-8068-2ced6b254d99 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:04.843616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 68/142] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:04.854094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:04.854546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:04.854638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:04.875573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:04.876752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:04.955279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 75/143] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:04.991092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e01036-f329-46c4-8068-2ced6b254d99 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.121478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e01036-f329-46c4-8068-2ced6b254d99 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:05.154950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:05.171912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b84b5-112a-4ed5-aa0b-60ff29d2f670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:05.172725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b84b5-112a-4ed5-aa0b-60ff29d2f670 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.173042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b84b5-112a-4ed5-aa0b-60ff29d2f670 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.173325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b84b5-112a-4ed5-aa0b-60ff29d2f670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.185847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b84b5-112a-4ed5-aa0b-60ff29d2f670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e49b84b5-112a-4ed5-aa0b-60ff29d2f670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:05.194232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:05.195145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:05.196360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 69/144] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:05.201380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.278470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c51706-abbc-4d9e-9be1-e2b4c1c6315b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.278793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c51706-abbc-4d9e-9be1-e2b4c1c6315b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.279044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c51706-abbc-4d9e-9be1-e2b4c1c6315b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.281315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 70/145] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:05.288339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.289209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.289504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.322473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:05.323695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:05.335774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:05.362921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dcfe1-78d5-457c-b439-849fd8763c50 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:05.423035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:05.423655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.423939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.424214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.425613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:05.425934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:05.428450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:05.448569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 76/146] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:05.454677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.483632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 71/147] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:05.517546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.611207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4d2d-c2a9-4626-b65b-4c0a94978ecc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:05.667485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:05.668587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.668872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.669176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.670600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:05.672784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:05.674796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 77/148] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:05 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:05.681181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.695007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:05.763407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df66c-fcc3-4053-88d6-dbb6e78e3cf8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:05.789579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:05.838132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:05.838956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.839240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.839511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.863695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:05.872166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:05.873082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:05.874310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 72/149] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:05.881571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.891506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa677e-e655-4ebc-b19b-ae776a6e9a96 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:05.954012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80faccec-0a9f-4ccc-957a-b9ca8d663a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:05.954920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faccec-0a9f-4ccc-957a-b9ca8d663a41 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.955372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faccec-0a9f-4ccc-957a-b9ca8d663a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.955795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faccec-0a9f-4ccc-957a-b9ca8d663a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.007361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec374-3d9a-4c95-a65e-bcf0db8ade9f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:06.045781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:06.046822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.047349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.047767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.048719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:06.049195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:06.050891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:06.055039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faccec-0a9f-4ccc-957a-b9ca8d663a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:06.056530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80faccec-0a9f-4ccc-957a-b9ca8d663a41 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:06.061855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 73/150] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:06.069185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:06.078360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:06.126817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:06.211405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 78/151] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:06.214447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0cfa5-d093-4e45-95b5-ebf39e34bfb0 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.216014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0cfa5-d093-4e45-95b5-ebf39e34bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.217549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0cfa5-d093-4e45-95b5-ebf39e34bfb0 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.219091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 79/152] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:06.222352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0cfa5-d093-4e45-95b5-ebf39e34bfb0 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:06.248213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b419a53-a64f-44d7-9740-970fe2108c74 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:06.306728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d85240-fb39-491e-a780-8ea069793b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:06.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85240-fb39-491e-a780-8ea069793b2b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.309193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85240-fb39-491e-a780-8ea069793b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.310203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d85240-fb39-491e-a780-8ea069793b2b None admin] PATH_INFO: `/v3/users/7e03bfa21ab542bd9c5a8fe91466ff60` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.311735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d85240-fb39-491e-a780-8ea069793b2b None admin] RBAC: Authorizing `identity:get_user(user_id=7e03bfa21ab542bd9c5a8fe91466ff60)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:06.318530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d85240-fb39-491e-a780-8ea069793b2b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:06.320409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 74/153] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:06 2022] GET /identity/v3/users/7e03bfa21ab542bd9c5a8fe91466ff60 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:06.321598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.321886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.322161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.355145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:06.357778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:06.378796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0cfa5-d093-4e45-95b5-ebf39e34bfb0 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:06.390767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:06.422021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:06.424008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.424507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.425034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.426725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:06.429261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:06.431967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 80/154] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:06 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:06.433146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:06.475226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 75/155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:06.476201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:06.533759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:06.616815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d227-71fd-400a-96e7-c14c0d3fda29 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:06.679940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e287c-37e5-4e2b-b069-da4c182ddf86 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:06.682765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:06.683648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.683930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.684202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.685474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:06.687177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:06.690061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 81/156] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:06 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:06.690834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:06.754443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:06.755014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.755300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.755675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.756712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=013b61df053d44f4935205044229122a, user.id=85b501a53389476b8ec65a6de4cce2e1) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:06.757734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:06.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe2312-eb7d-4176-96b0-07c3cf6780a0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:06.768176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 76/157] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:06 2022] GET /identity/v3/role_assignments?user.id=85b501a53389476b8ec65a6de4cce2e1&scope.project.id=013b61df053d44f4935205044229122a&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:06.782932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2d01-0881-48b9-b720-5c14d85834c6 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:06.783241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2d01-0881-48b9-b720-5c14d85834c6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:06.783491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c2d01-0881-48b9-b720-5c14d85834c6 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:06.786746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 77/158] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:06 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:06.787484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c2d01-0881-48b9-b720-5c14d85834c6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:06.799026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:06.943809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ebda-a75b-4c97-9df2-5fd887c5b039 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.009689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598456f-5289-46d2-88ef-10ba57a9362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.010426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598456f-5289-46d2-88ef-10ba57a9362e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.010825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598456f-5289-46d2-88ef-10ba57a9362e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.011028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598456f-5289-46d2-88ef-10ba57a9362e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.015506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:07.029945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c2d01-0881-48b9-b720-5c14d85834c6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.036227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598456f-5289-46d2-88ef-10ba57a9362e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3598456f-5289-46d2-88ef-10ba57a9362e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:07.053360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:07.054405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:07.055202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 82/159] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:07.056381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0099550-0115-4756-8826-5c8c8f6f56c5 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.056658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0099550-0115-4756-8826-5c8c8f6f56c5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.056970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0099550-0115-4756-8826-5c8c8f6f56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.087529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d0099550-0115-4756-8826-5c8c8f6f56c5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:07.088912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d0099550-0115-4756-8826-5c8c8f6f56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:07.096421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8471b8-c122-45af-9ac1-0eeb564fae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.097874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8471b8-c122-45af-9ac1-0eeb564fae29 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.099094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8471b8-c122-45af-9ac1-0eeb564fae29 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.099833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8471b8-c122-45af-9ac1-0eeb564fae29 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a/users/7e03bfa21ab542bd9c5a8fe91466ff60/roles/aeb7208c0c9a4b97ad2ad81d93210437` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.106382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8471b8-c122-45af-9ac1-0eeb564fae29 None admin] RBAC: Authorizing `identity:create_grant(project_id=013b61df053d44f4935205044229122a, user_id=7e03bfa21ab542bd9c5a8fe91466ff60, role_id=aeb7208c0c9a4b97ad2ad81d93210437)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:07.108754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8471b8-c122-45af-9ac1-0eeb564fae29 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:07.133679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 78/160] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:06 2022] PUT /identity/v3/projects/013b61df053d44f4935205044229122a/users/7e03bfa21ab542bd9c5a8fe91466ff60/roles/aeb7208c0c9a4b97ad2ad81d93210437 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:07.135036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24549d88-579f-43c1-88b0-fd7ff6c2a8a4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.135306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24549d88-579f-43c1-88b0-fd7ff6c2a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.135589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24549d88-579f-43c1-88b0-fd7ff6c2a8a4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.137208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 79/161] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:07.137940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24549d88-579f-43c1-88b0-fd7ff6c2a8a4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:07.220424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:07.222901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.227919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.228212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.262892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:07.264018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:07.320995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:07.345565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24549d88-579f-43c1-88b0-fd7ff6c2a8a4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.372591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 84/163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:07.373514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:07.387546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.388385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.388710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.389026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.389841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:07.390327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:07.391807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:07.403507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 80/164] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:07.410370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:07.436795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:07.536630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab72c2-442c-4a35-a9b4-47cd68710df7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.543185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df653a15-ddcc-47df-ba97-229bfe336dbc None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.577089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.577972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.578257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.578643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.579973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:07.581531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:07.583931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:07.584704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:07.589093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.589900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.590176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.590447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.610137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:07.625614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:07.626540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:07.627363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 85/166] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:07.628272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:07.669058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:07.677600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:07.701305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f349f31-5836-4ddd-b545-dcc464494688 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.757833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec675e01-5cad-4ac9-b5fe-a280a7e78d20 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:07.762828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.763717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.764004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.764453 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.783753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:07.803112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:07.804049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:07.804846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:07.805577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:07.805577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:07.805577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:07.805768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 82/167] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:07.805843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:07.809306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:07.874386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:07.875881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:07.901268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:07.978742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 86/168] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:07.983980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.087559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016ab37-d961-41e0-a0ea-dbbeaf2d9985 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.089858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d4f04-e0a7-4389-9e67-fdd739c7e978 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.114009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:08.126341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.127028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.127308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.127582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.128326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:08.128627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.130579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.139574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 87/169] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:08.140467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.198391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.199081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.199369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.199651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.200421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:08.200727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.202153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.220305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 83/170] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:08.221007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.235501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:08.252398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bcac2-0117-4f3a-9afa-117138cdefdb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.291238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.292109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.292386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.292655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] PATH_INFO: `/v3/projects/b57f2a8c772a4abc84de91a2c335e19f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.294026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b57f2a8c772a4abc84de91a2c335e19f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.295639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.297385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 88/171] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:08 2022] GET /identity/v3/projects/b57f2a8c772a4abc84de91a2c335e19f => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:08.302698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.367779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:08.421329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a0bf4-5086-45ae-89a7-300f6a0ad6a1 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.449526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2d29d-5214-47e0-b0c1-da42e208df05 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.461972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.463511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.463933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.464340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] PATH_INFO: `/v3/users/52d40fe0347f4d97acf889a2462a0c46` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.465705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] RBAC: Authorizing `identity:get_user(user_id=52d40fe0347f4d97acf889a2462a0c46)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.467662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.469818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 89/172] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:08 2022] GET /identity/v3/users/52d40fe0347f4d97acf889a2462a0c46 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:08.471198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.519281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.520868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.521279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.521652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] PATH_INFO: `/v3/users/85b501a53389476b8ec65a6de4cce2e1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.523099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] RBAC: Authorizing `identity:get_user(user_id=85b501a53389476b8ec65a6de4cce2e1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.524725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.526589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 84/173] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:08 2022] GET /identity/v3/users/85b501a53389476b8ec65a6de4cce2e1 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:08.527440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.596970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7778-0781-4f44-ba01-609274fe1359 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.610171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:08.629978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:08.638903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab1496-129f-4210-a753-c7aef25a4da1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.645583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.646466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.646886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.647326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.648768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=b57f2a8c772a4abc84de91a2c335e19f, user.id=85b501a53389476b8ec65a6de4cce2e1) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:08.649250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.651753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50896453-e2c0-4fd9-9ab6-c4236ff0d19a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.665442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 90/174] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:08 2022] GET /identity/v3/role_assignments?user.id=85b501a53389476b8ec65a6de4cce2e1&scope.project.id=b57f2a8c772a4abc84de91a2c335e19f&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:08.667979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3e58-d2cb-4e38-a660-1dd3c8f9ec8d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.668268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3e58-d2cb-4e38-a660-1dd3c8f9ec8d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.668546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3e58-d2cb-4e38-a660-1dd3c8f9ec8d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.671921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 91/175] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:08.672697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a3e58-d2cb-4e38-a660-1dd3c8f9ec8d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:08.701190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f8f2d-82ef-4e75-834e-0b58e40a8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.701872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8f2d-82ef-4e75-834e-0b58e40a8027 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.702155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8f2d-82ef-4e75-834e-0b58e40a8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.702430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f8f2d-82ef-4e75-834e-0b58e40a8027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.817615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f8f2d-82ef-4e75-834e-0b58e40a8027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:08.821641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f8f2d-82ef-4e75-834e-0b58e40a8027 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:08.881057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a3e58-d2cb-4e38-a660-1dd3c8f9ec8d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:08.939337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eeeb0-3d78-4a37-bbec-21bffeff82ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:08.940158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eeeb0-3d78-4a37-bbec-21bffeff82ed None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.940538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eeeb0-3d78-4a37-bbec-21bffeff82ed None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.940907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eeeb0-3d78-4a37-bbec-21bffeff82ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:08.944671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:08.981059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 85/176] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:08.983488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5820-eda7-4388-840a-935ba33d0764 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:08.983929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5820-eda7-4388-840a-935ba33d0764 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:08.984350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5820-eda7-4388-840a-935ba33d0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.006918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-13bc5820-eda7-4388-840a-935ba33d0764 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:09.008248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-13bc5820-eda7-4388-840a-935ba33d0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:09.009104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.027827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7eeeb0-3d78-4a37-bbec-21bffeff82ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:09.030325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7eeeb0-3d78-4a37-bbec-21bffeff82ed None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:09.100261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 86/177] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:09.101646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918bbb7-72f8-4c7a-bbb3-84c8681334ea None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.101989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918bbb7-72f8-4c7a-bbb3-84c8681334ea None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.102265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918bbb7-72f8-4c7a-bbb3-84c8681334ea None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.103678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 87/178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:09.104239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918bbb7-72f8-4c7a-bbb3-84c8681334ea None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.147415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 92/179] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:09.152976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea89a-ac2c-4880-9b42-bff8ab4c81e8 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.153273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea89a-ac2c-4880-9b42-bff8ab4c81e8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.153555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ea89a-ac2c-4880-9b42-bff8ab4c81e8 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.154990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 93/180] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:09.155993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.156262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.156435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.177676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:09.178862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:09.224659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918bbb7-72f8-4c7a-bbb3-84c8681334ea None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.228511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.251409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 94/181] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:09.257965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.267808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.269570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.269960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.271249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:09.273205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:09.275362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 88/182] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:09.278233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.280606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.371463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258444d-1a0b-47b2-8702-c2bda3c8a9e3 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.382040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb839f7-f2cd-466b-a80d-40f6995da142 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.408950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.409808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.410196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.411010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.417544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc28062-ee88-4b63-b6df-c3e0e0c04a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.418403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28062-ee88-4b63-b6df-c3e0e0c04a08 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.418689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28062-ee88-4b63-b6df-c3e0e0c04a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.418967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc28062-ee88-4b63-b6df-c3e0e0c04a08 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.420152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc28062-ee88-4b63-b6df-c3e0e0c04a08 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:09.421639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc28062-ee88-4b63-b6df-c3e0e0c04a08 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:09.423117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:09.423332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 89/183] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:09.424458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.424742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.425046 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:09.432620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:09.433693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 95/184] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:09.437736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.449279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:09.450458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:09.484321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.525323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:09.525323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.527047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.552047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ff0f-b44d-49f9-8d16-cbe5dd4311f8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.591370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.592337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.592617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.592888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.604045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:09.612570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:09.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:09.614627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 96/186] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:09.617072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.642311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3dd62-f3f3-49e3-9129-38cfb8cbd4e3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.680870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.681967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.682489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.682943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.683968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=013b61df053d44f4935205044229122a, user.id=52d40fe0347f4d97acf889a2462a0c46) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:09.684458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:09.686371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:09.693313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 91/187] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/role_assignments?user.id=52d40fe0347f4d97acf889a2462a0c46&scope.project.id=013b61df053d44f4935205044229122a&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:09.694164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.731037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c087c1-2800-403a-9d00-1679d68a8298 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.762472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.792519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.793315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.793966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.794323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.795255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] RBAC: Adding query filter params (role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=013b61df053d44f4935205044229122a, user.id=85b501a53389476b8ec65a6de4cce2e1) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:09.795791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:09.798499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:09.802868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:09.807961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 97/188] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/role_assignments?user.id=85b501a53389476b8ec65a6de4cce2e1&scope.project.id=013b61df053d44f4935205044229122a&role.id=ce695803124649b4ad62ca6ec15c935e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:09.809656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.860709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ef17-9430-4446-a5fd-002f814d6a8c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.913099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:09.914307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:09.914800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:09.915150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:09.916002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:09.916646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:09.918656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:09.933106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 92/189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:09.933106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:09.946123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea32988-7176-40ea-b1b5-a0277e00b322 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:09.999731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.001424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.001917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.005388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.007576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.011082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 98/190] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:10.012891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.062617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.070459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a569eb-3387-423a-bd07-fadf5289c363 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.110964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.123530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.124211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.124500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.124778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.125620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:10.125958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.128342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.141394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 93/191] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:10.142559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.165003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb152f-c919-4a4b-b6c0-22ee61097101 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.205361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.206172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.206454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.206836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] PATH_INFO: `/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.220040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] RBAC: Authorizing `identity:get_user(user_id=e36485df7a1a4ae4b93cebdb0c8af37c)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.221551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.223995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 99/192] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:10.224828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.259964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435bc48-c825-42f1-8788-9cef71cb19ec None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.293348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee389-5532-4d33-90f8-70cad87d8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.294018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee389-5532-4d33-90f8-70cad87d8509 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.294303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee389-5532-4d33-90f8-70cad87d8509 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.294583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee389-5532-4d33-90f8-70cad87d8509 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.295292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee389-5532-4d33-90f8-70cad87d8509 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.296771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee389-5532-4d33-90f8-70cad87d8509 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.322614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 94/193] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:10 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:10.323907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279eb1-a827-4615-8bea-74f3d1c24b1a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.324199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279eb1-a827-4615-8bea-74f3d1c24b1a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.324679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36279eb1-a827-4615-8bea-74f3d1c24b1a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.325755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 95/194] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:10.326467 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279eb1-a827-4615-8bea-74f3d1c24b1a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.344435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.353505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0318-a6c7-4614-80a8-1ceeb80f1e46 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.385573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.396786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5b461-05c0-4b43-a455-4a2baa7ac46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.397762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b461-05c0-4b43-a455-4a2baa7ac46b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.398143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b461-05c0-4b43-a455-4a2baa7ac46b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.398472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b461-05c0-4b43-a455-4a2baa7ac46b None admin] PATH_INFO: `/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.399771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5b461-05c0-4b43-a455-4a2baa7ac46b None admin] RBAC: Authorizing `identity:get_user(user_id=e36485df7a1a4ae4b93cebdb0c8af37c)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.401278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5b461-05c0-4b43-a455-4a2baa7ac46b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.407540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 100/195] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:10.407540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.407540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.407540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.422369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:10.423589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:10.455517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36279eb1-a827-4615-8bea-74f3d1c24b1a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.497432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.498093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.498375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.498647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.505328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 101/196] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:10.506017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.576207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.577965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.602466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.632299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec393b-5224-4c9d-9834-8c7a50e84c6c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.658980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.675675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.676965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.677269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.677544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.705235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:10.706541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.765965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:10.767479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:10.850181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a15a6-ffbd-4a19-a741-29b392bcbbad None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:10.869309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.882583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 102/198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:10.894050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:10.899000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:10.900357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:10.900919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:10.901513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:10.917664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:10.922575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:10.930124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:10.931018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:10.931808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:10.934380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:10.935315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:11.028731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be67d62-fc82-441d-a0da-37182cc24865 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.048313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395bc6b-a52c-426e-82fd-25d2ac9dea66 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.076382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.078130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.078591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.079259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.081283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.083516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.090304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.090304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.090304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.090304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.090684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 103/200] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:11.090684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:11.091644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.093135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.094851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:10 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:11.096220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:11.149584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:11.201073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:11.213944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f404fa-d132-4a4b-a18f-b4e9cfaec787 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.226229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d85a-4f45-42be-8656-aed70d1bd4bb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.260826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.261967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.262482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.262857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.263151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.263648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.264024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.264373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.264613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:11.265106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.265431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=e36485df7a1a4ae4b93cebdb0c8af37c) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:11.265814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.267022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.267391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.273942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 99/202] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:11 2022] GET /identity/v3/role_assignments?user.id=e36485df7a1a4ae4b93cebdb0c8af37c&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:11.274870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:11.279406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 104/203] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:11.290502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:11.443988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756c90-8c01-41e1-8de2-6e6ae43f33ac None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.486662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.487839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.488292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.488791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] PATH_INFO: `/v3/users/7e03bfa21ab542bd9c5a8fe91466ff60` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.490201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] RBAC: Authorizing `identity:get_user(user_id=7e03bfa21ab542bd9c5a8fe91466ff60)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.491813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.493635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:11 2022] GET /identity/v3/users/7e03bfa21ab542bd9c5a8fe91466ff60 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:11.501432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba247e-65d1-4295-8796-48b0e36d796b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.508711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:11.510618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:11.534443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:11.552206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.553232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.553768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.554253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.555439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] RBAC: Adding query filter params (role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=e36485df7a1a4ae4b93cebdb0c8af37c) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:11.556025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.557753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.564363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 100/205] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:11 2022] GET /identity/v3/role_assignments?user.id=e36485df7a1a4ae4b93cebdb0c8af37c&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=ce695803124649b4ad62ca6ec15c935e => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:11.635173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34513156-13c9-43a0-a19b-3497d253e46f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:11.674650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:11.675669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.676258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.676728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.779270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:11.780788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:11.808984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:11.906773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 106/206] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:41:11.912227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:12.060840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8583f4-df9f-442f-9270-899ed5e1e8b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:12.110163 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a745686-5189-4b48-a488-47f017ce7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:12.111407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745686-5189-4b48-a488-47f017ce7d8f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:12.111884 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745686-5189-4b48-a488-47f017ce7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:12.112349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a745686-5189-4b48-a488-47f017ce7d8f None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:12.114387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745686-5189-4b48-a488-47f017ce7d8f None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:12.116295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a745686-5189-4b48-a488-47f017ce7d8f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:12.118523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:11 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:12.124155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:12.274220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da6e0-c10a-45d5-853e-07c256904f7b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:12.310836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:12.324141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:12.324730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:12.325034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:12.325315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:12.326148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] RBAC: Adding query filter params (role.id=aeb7208c0c9a4b97ad2ad81d93210437, scope.project.id=013b61df053d44f4935205044229122a, user.id=7e03bfa21ab542bd9c5a8fe91466ff60) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:12.326455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:12.327916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434eb54-6b87-4cb7-99a2-23d158e92916 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:12.335271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:12 2022] GET /identity/v3/role_assignments?user.id=7e03bfa21ab542bd9c5a8fe91466ff60&scope.project.id=013b61df053d44f4935205044229122a&role.id=aeb7208c0c9a4b97ad2ad81d93210437 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:12.765271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1ed04-8abc-4799-ac33-80a1ca83b67f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:12.765699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1ed04-8abc-4799-ac33-80a1ca83b67f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:12.765904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1ed04-8abc-4799-ac33-80a1ca83b67f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:12.767475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 102/209] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:12.773569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180f532-6d29-4708-be33-9ab942c73770 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:12.774116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180f532-6d29-4708-be33-9ab942c73770 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:12.774605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180f532-6d29-4708-be33-9ab942c73770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:12.792498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5180f532-6d29-4708-be33-9ab942c73770 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:12.794020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5180f532-6d29-4708-be33-9ab942c73770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:12.869916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 108/210] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:12.879574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16a13d-5622-4a5e-8153-4a2c912cf8b5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:12.879921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16a13d-5622-4a5e-8153-4a2c912cf8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:12.880124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16a13d-5622-4a5e-8153-4a2c912cf8b5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:12.881666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 103/211] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:12.886616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:12.886904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:12.887183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:12.897961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16a13d-5622-4a5e-8153-4a2c912cf8b5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:12.906163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:12.907335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:12.954891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:12.981667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 109/212] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:13.007216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.032920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16a13d-5622-4a5e-8153-4a2c912cf8b5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:13.061719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:13.071580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:13.072386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.072743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.073047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.084078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:13.091793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:13.092689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:13.093513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:13.097044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 104/213] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:13.100229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.127431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5db2e4-8dab-4b5f-8c93-d3907843045c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:13.164865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:13.165957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.166436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.166877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.168336 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:13.170064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:13.172222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 110/214] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:13.181031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.211198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:13.215298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252585-271f-4cc6-8f17-3687816fe447 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:13.252057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:13.252725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.253138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.253415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.254743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:13.255152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:13.256718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:13.266415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 105/215] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:13.273022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.308498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d105da-c42f-4a39-a89d-1c193e72eaab None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:13.323391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:13.345492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:13.346173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.346452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.346723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.347421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:13.349487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:13.381233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 111/216] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:13 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:13.402599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31aee2a-8d67-4b22-8595-e4f0df1d3f2c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:13.444649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1625d5-a729-412d-83f1-169348e0d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:13.445676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1625d5-a729-412d-83f1-169348e0d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.445963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1625d5-a729-412d-83f1-169348e0d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.446239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1625d5-a729-412d-83f1-169348e0d8f4 None admin] PATH_INFO: `/v3/users/494ca28821f04e7abda35b24221cd4a0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.463461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1625d5-a729-412d-83f1-169348e0d8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=494ca28821f04e7abda35b24221cd4a0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:13.465218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1625d5-a729-412d-83f1-169348e0d8f4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:13.467398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 106/217] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:13 2022] GET /identity/v3/users/494ca28821f04e7abda35b24221cd4a0 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:13.473268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.589839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647a6d0-0afb-4204-8aad-e5099865efcc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:13.626260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:13.626920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.627200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.627470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.670942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:13.709901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:13.711501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:13.726835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770127be-ac44-4d8a-96fa-125465a02af3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.727123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770127be-ac44-4d8a-96fa-125465a02af3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.727379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770127be-ac44-4d8a-96fa-125465a02af3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.729074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 107/218] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:13.735762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:13.736053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:13.736333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:13.765573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:13.767461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:13.807279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:13.853467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 112/219] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:13.862061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.921043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 108/220] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:13.976816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:13.989778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:14.040587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbd32d-963e-4363-b7a0-825ac7dd8105 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.082866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf84236-96df-42f4-94dd-35ec2a1264b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.083866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf84236-96df-42f4-94dd-35ec2a1264b2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.084146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf84236-96df-42f4-94dd-35ec2a1264b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.084422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf84236-96df-42f4-94dd-35ec2a1264b2 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.086228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf84236-96df-42f4-94dd-35ec2a1264b2 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:14.088168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf84236-96df-42f4-94dd-35ec2a1264b2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:14.090667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 113/221] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:13 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:14.092466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460ae5-ff91-4996-9af2-8f848cc67280 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.092758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460ae5-ff91-4996-9af2-8f848cc67280 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.093061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d460ae5-ff91-4996-9af2-8f848cc67280 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.094596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 114/222] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:14.096771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d460ae5-ff91-4996-9af2-8f848cc67280 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.110673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb931a-17f0-4b6b-9479-579fd3fde6d8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.148464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf5708-9c29-49b2-9110-111ccc46d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.149304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5708-9c29-49b2-9110-111ccc46d068 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.149592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5708-9c29-49b2-9110-111ccc46d068 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.149872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf5708-9c29-49b2-9110-111ccc46d068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.160313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf5708-9c29-49b2-9110-111ccc46d068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d3cf5708-9c29-49b2-9110-111ccc46d068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:14.169338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:14.170564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 109/223] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:14.172540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.174178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.174178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.196057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:14.197994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:14.213279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:14.224758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d460ae5-ff91-4996-9af2-8f848cc67280 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.268063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.268755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.269425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.269715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.271351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=494ca28821f04e7abda35b24221cd4a0) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:14.271668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:14.273920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:14.281187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 115/224] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/role_assignments?user.id=494ca28821f04e7abda35b24221cd4a0&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:14.282080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.285823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:14.289171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:14.308518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.412163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945c480-6590-4193-afea-b8565b577e8a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.450290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edb0d8-2a55-4f60-a0de-e85436d23a26 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.479738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.480434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.480716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.481013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.481836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:14.482148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:14.483570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:14.500452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 116/226] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:14.505853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.531704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.532580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.533089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.533368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.544750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:14.549834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:14.566242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:14.567328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:14.568210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:14.574390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 111/227] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:14.576785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.593289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:14.663510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d0d9-3145-4fb2-9f0a-8b86efda3041 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.725062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963c714-3178-4c55-a9d9-36a1f144a290 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.764313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.766868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.766868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.766868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.767520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:14.772955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:14.772955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:14.779032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:14.782965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.783859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.784135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.784401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] PATH_INFO: `/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.786626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.787998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] RBAC: Authorizing `identity:get_user(user_id=e36485df7a1a4ae4b93cebdb0c8af37c)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:14.789740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:14.791634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:14.801972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:14.855985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:14.949574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df752c1d-a43b-4cf4-8b20-9dc7d723e4ce None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.953074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9dcb-4cd5-4dd7-a681-85f57114a246 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:14.987859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:14.989520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:14.989809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:14.990086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] PATH_INFO: `/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:14.991405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] RBAC: Authorizing `identity:get_user(user_id=e36485df7a1a4ae4b93cebdb0c8af37c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:14.992879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:14.995895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 113/230] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:15.000870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:15.011802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:15.022304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:15.023184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.023463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.023739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.025980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:15.027441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:15.031775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 118/231] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:14 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:15.037042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:15.146659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767701-8dbe-4664-a250-8d0a57904815 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:15.175840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dad5e-9ab1-46c5-83db-651cba72fdc1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:15.198901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:15.199860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.200084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.200355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc/users/e36485df7a1a4ae4b93cebdb0c8af37c/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.202350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e4f17634924aae91ae8465492529bc, user_id=e36485df7a1a4ae4b93cebdb0c8af37c, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:15.204060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:15.219335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 119/232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:15 2022] PUT /identity/v3/projects/a6e4f17634924aae91ae8465492529bc/users/e36485df7a1a4ae4b93cebdb0c8af37c/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:15.240152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:15.261856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468412-5ce8-4d0f-88b9-53af2c8051ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:15.262817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468412-5ce8-4d0f-88b9-53af2c8051ab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.263089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468412-5ce8-4d0f-88b9-53af2c8051ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.263362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468412-5ce8-4d0f-88b9-53af2c8051ab None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.264736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7468412-5ce8-4d0f-88b9-53af2c8051ab None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:15.266244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7468412-5ce8-4d0f-88b9-53af2c8051ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:15.268319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 114/233] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:15 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:15.274553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:15.385463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:15.434287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd96573-a998-489b-b326-48fb8884c91e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:15.476891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a12d05-9019-48af-aa02-e7c98dc64d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:15.477734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12d05-9019-48af-aa02-e7c98dc64d65 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.478066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12d05-9019-48af-aa02-e7c98dc64d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.478343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a12d05-9019-48af-aa02-e7c98dc64d65 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc/users/e36485df7a1a4ae4b93cebdb0c8af37c/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.480604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a12d05-9019-48af-aa02-e7c98dc64d65 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e4f17634924aae91ae8465492529bc, user_id=e36485df7a1a4ae4b93cebdb0c8af37c, role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:15.482097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a12d05-9019-48af-aa02-e7c98dc64d65 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:15.502295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 120/234] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:15 2022] PUT /identity/v3/projects/a6e4f17634924aae91ae8465492529bc/users/e36485df7a1a4ae4b93cebdb0c8af37c/roles/ce695803124649b4ad62ca6ec15c935e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:15.880625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761d75-42a3-41b8-b4a5-a2694b8ed4e3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.881157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761d75-42a3-41b8-b4a5-a2694b8ed4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.881259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69761d75-42a3-41b8-b4a5-a2694b8ed4e3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.882786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 115/235] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:15.888172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20821a07-826b-485e-bf9a-5ccb17cd9400 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.888469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20821a07-826b-485e-bf9a-5ccb17cd9400 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.888747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20821a07-826b-485e-bf9a-5ccb17cd9400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.910585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-20821a07-826b-485e-bf9a-5ccb17cd9400 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:15.911771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-20821a07-826b-485e-bf9a-5ccb17cd9400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:15.996582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 121/236] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:16.028100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69761d75-42a3-41b8-b4a5-a2694b8ed4e3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:16.140025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69761d75-42a3-41b8-b4a5-a2694b8ed4e3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:16.151108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154eefc-9c58-4c47-8663-4cbecb040475 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.151393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154eefc-9c58-4c47-8663-4cbecb040475 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.151669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154eefc-9c58-4c47-8663-4cbecb040475 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.153091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 122/237] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:16.158295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.158579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.158851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.181536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:16.182719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:16.200543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:16.201416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.201695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.202020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.216038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:16.224435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:16.225393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:16.226211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 116/238] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:16.234083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:16.266671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:16.292247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 123/239] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:16.317479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:16.364394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:16.462443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c4434-c546-4a3f-83f4-08dccbfa22e4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:16.483620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98818-0676-4ea2-8c19-c9c26475f6ac None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:16.530910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:16.531592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.531878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.532158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.532916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:16.533373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:16.534792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:16.553718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:16.554460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.554748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.555029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.556222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:16.557829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:16.559470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 117/240] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:16.565528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 124/241] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:16.566406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:16.570298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:16.634091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:16.676569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331ce41-d84a-45cd-998d-ab49f3ab04f2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:16.728821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:16.729537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.729822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.730100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.730827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:16.732311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:16.756591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 125/242] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:16 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:41:16.829582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5a96e-9da4-4ec7-89a6-1b6c4950f65f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:16.854147 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:16.886775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f3715-8cf8-42b5-80da-6d9287678bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:16.887679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f3715-8cf8-42b5-80da-6d9287678bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.887963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f3715-8cf8-42b5-80da-6d9287678bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.888238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f3715-8cf8-42b5-80da-6d9287678bc0 None admin] PATH_INFO: `/v3/users/f21db4c7e87646609e9f60ec533efc72` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.903631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f3715-8cf8-42b5-80da-6d9287678bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=f21db4c7e87646609e9f60ec533efc72)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:16.909222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f3715-8cf8-42b5-80da-6d9287678bc0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:16.913371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 118/243] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:16 2022] GET /identity/v3/users/f21db4c7e87646609e9f60ec533efc72 => generated 297 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:16.918311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:16.942346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fed9cd-fc78-46a5-85e3-d2e29b3d7adc None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.943312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fed9cd-fc78-46a5-85e3-d2e29b3d7adc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.943598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fed9cd-fc78-46a5-85e3-d2e29b3d7adc None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.945038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 119/244] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:16.950941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.951229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.951506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.971695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:16.974778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:17.039227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873dce-1879-400f-8fb4-3953fa198bf9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:17.041975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:17.055286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 120/245] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:17.078823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:17.079550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.079894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.080125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.081736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:17.158527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:17.160142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:17.198225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827af324-03d9-4e5e-bd1f-cea404c41cc1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:17.206023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:17.239190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:17.240629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.240915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.241225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.254470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:17.264082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:17.265020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:17.265925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:17.269114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 121/246] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:17.272706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:17.276750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 126/247] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:17.282387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:17.292040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:17.389673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628690d-ee2c-4f54-8fe0-874cd3d7e46b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:17.433727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63568661-2bd1-4c3c-a7a6-f86ee6eace7e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:17.435135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:17.436270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.436750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.437244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.438717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:17.440400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:17.443274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 127/248] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:17.449647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:17.491017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:17.491711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.492000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.492283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.493077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:17.493391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:17.494806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:17.511731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 122/249] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:17.518684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:17.554575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:17.563128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:17.595396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dd93e-59d5-4426-9813-2824f3ba87c6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:17.634036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:17.634709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.634996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.635277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.636119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] RBAC: Adding query filter params (role.id=aeb7208c0c9a4b97ad2ad81d93210437, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=f21db4c7e87646609e9f60ec533efc72) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:17.636447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:17.638087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:17.644758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 128/250] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/role_assignments?user.id=f21db4c7e87646609e9f60ec533efc72&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=aeb7208c0c9a4b97ad2ad81d93210437 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:17.714508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfcec5-7edc-4131-b609-26ed81f8b297 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:17.780978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f57ba1-4d10-4247-8c33-a472c738877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:17.780978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f57ba1-4d10-4247-8c33-a472c738877a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.780978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f57ba1-4d10-4247-8c33-a472c738877a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.780978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f57ba1-4d10-4247-8c33-a472c738877a None admin] PATH_INFO: `/v3/users/494ca28821f04e7abda35b24221cd4a0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.785876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f57ba1-4d10-4247-8c33-a472c738877a None admin] RBAC: Authorizing `identity:get_user(user_id=494ca28821f04e7abda35b24221cd4a0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:17.787383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f57ba1-4d10-4247-8c33-a472c738877a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:17.789924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 123/251] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/users/494ca28821f04e7abda35b24221cd4a0 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:17.795344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:17.845158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dea50-adcd-4cb4-a6da-1e5fcc8cf0a4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.845463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dea50-adcd-4cb4-a6da-1e5fcc8cf0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.845719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dea50-adcd-4cb4-a6da-1e5fcc8cf0a4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.847310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 124/252] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:17.852653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:17.852952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:17.853255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:17.871672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:17.872853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:17.947327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 125/253] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:17.970463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:18.001073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:18.001958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69355972-e5ba-4bc8-bb32-81d02aca3cba None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:18.045533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:18.046498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.046877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.047155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.048350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:18.049833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:18.052423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 129/254] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:18.058670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:18.065987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:18.095674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a7d44-415d-4778-8304-3430450d553a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:18.137910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:18.138771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.139063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.139339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.153717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:18.162680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:18.163872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:18.164681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 126/255] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:18.171797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:18.277389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:18.282404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7569d4-ea4c-48c0-9e75-dba3d4d99b62 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:18.328765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4cf93-33e0-43c2-8af1-bf3671bfeae0 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:18.349856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:18.350543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.350832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.351113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.351874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:18.352186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:18.353612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a727c-23f8-43e4-9229-69cebaa735b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:18.362926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 127/256] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:18.369229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f683b-0e34-4199-98bd-c20eff2692e4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.369690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f683b-0e34-4199-98bd-c20eff2692e4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.370148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f683b-0e34-4199-98bd-c20eff2692e4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.371607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 128/257] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:18.372437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f683b-0e34-4199-98bd-c20eff2692e4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:18.417671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf2e6-80f7-4bf8-bd54-0a048ff25f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:18.418578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf2e6-80f7-4bf8-bd54-0a048ff25f3b None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.419052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf2e6-80f7-4bf8-bd54-0a048ff25f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.419474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf2e6-80f7-4bf8-bd54-0a048ff25f3b None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc/users/494ca28821f04e7abda35b24221cd4a0/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.425720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadf2e6-80f7-4bf8-bd54-0a048ff25f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e4f17634924aae91ae8465492529bc, user_id=494ca28821f04e7abda35b24221cd4a0, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:18.428050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadf2e6-80f7-4bf8-bd54-0a048ff25f3b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:18.451862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 130/258] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:18 2022] PUT /identity/v3/projects/a6e4f17634924aae91ae8465492529bc/users/494ca28821f04e7abda35b24221cd4a0/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:41:18.453618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.454082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.454506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.483994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:18.485385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:18.487533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f683b-0e34-4199-98bd-c20eff2692e4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:18.525270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:18.526414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.526842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.527259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] PATH_INFO: `/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.528782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] RBAC: Authorizing `identity:get_user(user_id=e36485df7a1a4ae4b93cebdb0c8af37c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:18.530564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:18.532869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 129/259] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:18 2022] GET /identity/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:18.539663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:18.576959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:18.670703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451a472-902b-46ae-ab21-a936a42ca18f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:18.690794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:18.727709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:18.728685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:18.729208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:18.729660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:18.730310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 131/260] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:18.806019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:18.809056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:18.810729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:18.873360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:18.951747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 130/261] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:41:18.958513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:19.131724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20f69c-4265-4ea2-9975-f4c6a069e452 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:19.176715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9605f5-a97e-4091-8ec8-fc784b931e26 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:19.213285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:19.223816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:19.224792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:19.225094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:19.225376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:19.250011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:19.259225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:19.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:19.261436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 132/262] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:19.267123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:19.268343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:19.268343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:19.268596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:19.269823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:19.271729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:19.273642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 131/263] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:18 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:19.277939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:19.279850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:19.405312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:19.497143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ecdcd-8525-40ae-9d7a-4b9c4c9ecde5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:19.560154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f73e5c-f8a9-43ef-853b-372839badde4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:19.565620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:19.566315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:19.567227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:19.567577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:19.568343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:19.568656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:19.570101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:19.581476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 133/264] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:19.585384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:19.639139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:19.639800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:19.640150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:19.640427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:19.641383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=e36485df7a1a4ae4b93cebdb0c8af37c) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:19.641697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:19.643242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:19.659438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 132/265] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:19 2022] GET /identity/v3/role_assignments?user.id=e36485df7a1a4ae4b93cebdb0c8af37c&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:19.748114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc4739-cca2-4b37-ba39-7d992f0dce97 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:19.770528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:19.786661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:19.787976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:19.788972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:19.789261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] PATH_INFO: `/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:19.790556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] RBAC: Authorizing `identity:get_user(user_id=e36485df7a1a4ae4b93cebdb0c8af37c)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:19.792038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:19.793776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 134/266] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:19 2022] GET /identity/v3/users/e36485df7a1a4ae4b93cebdb0c8af37c => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:19.799410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:19.857527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:19.935679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f5c3-1bab-45ce-bcc9-0f966131b817 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:19.971096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f117e-5c7a-4d32-b51a-bebc831b37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:19.971840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f117e-5c7a-4d32-b51a-bebc831b37ea None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:19.972041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f117e-5c7a-4d32-b51a-bebc831b37ea None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:19.972325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f117e-5c7a-4d32-b51a-bebc831b37ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.046891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f117e-5c7a-4d32-b51a-bebc831b37ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:20.048400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f117e-5c7a-4d32-b51a-bebc831b37ea None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:20.100699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:20.157318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 133/267] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:20.163430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.284758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ae846-9d5c-46e6-b1f5-0648d667bb55 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:20.295879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1677a29-5070-4ba9-a84f-f777ff91b710 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.296514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1677a29-5070-4ba9-a84f-f777ff91b710 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.297020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1677a29-5070-4ba9-a84f-f777ff91b710 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.302996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 134/268] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:20.304574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.305136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.305639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.324403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:20.325313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.325600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.325877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.332955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:20.332955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:20.333445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 135/269] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:20 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:20.339119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.341431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:20.342855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:20.400399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:20.451337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b66b9-8544-4a98-b220-900254f7ba71 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:20.492956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:20.492956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.492956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.492956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.493372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] RBAC: Adding query filter params (role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=e36485df7a1a4ae4b93cebdb0c8af37c) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:20.493372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:20.493372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e57f8-1de8-42c6-b149-405fdf510f3f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:20.496089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 135/270] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:20.499558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 136/271] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:20 2022] GET /identity/v3/role_assignments?user.id=e36485df7a1a4ae4b93cebdb0c8af37c&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=ce695803124649b4ad62ca6ec15c935e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:20.533589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.651661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:20.656478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29577f-0a0d-4162-8617-daa9694bf448 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.656771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29577f-0a0d-4162-8617-daa9694bf448 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.657079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29577f-0a0d-4162-8617-daa9694bf448 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.658576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 137/272] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:20.664606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45d90-30cb-45e9-8f77-9cfbbb9c783d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.665157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45d90-30cb-45e9-8f77-9cfbbb9c783d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.665635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45d90-30cb-45e9-8f77-9cfbbb9c783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.684729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0af45d90-30cb-45e9-8f77-9cfbbb9c783d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:20.686645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0af45d90-30cb-45e9-8f77-9cfbbb9c783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:20.688717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a2bde-20f3-4439-8d77-a07f42179e60 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:20.735787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9378ef-69af-4e3c-bff4-214a2b5fadb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:20.736598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9378ef-69af-4e3c-bff4-214a2b5fadb1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.736879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9378ef-69af-4e3c-bff4-214a2b5fadb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.737256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9378ef-69af-4e3c-bff4-214a2b5fadb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.738482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9378ef-69af-4e3c-bff4-214a2b5fadb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:20.740042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9378ef-69af-4e3c-bff4-214a2b5fadb1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:20.741850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 136/273] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:20.746650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea894b-f7f6-4d04-afae-418ec4ebdd8b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.746650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea894b-f7f6-4d04-afae-418ec4ebdd8b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.746650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea894b-f7f6-4d04-afae-418ec4ebdd8b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.746650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 137/274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:20.749951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea894b-f7f6-4d04-afae-418ec4ebdd8b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.780500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 138/275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:20.781709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.781974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.782248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.800625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:20.804703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:20.860009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:20.875530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea894b-f7f6-4d04-afae-418ec4ebdd8b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:20.883947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 139/276] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:20.884715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.919853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:20.920451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.920742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.921051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.921768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:20.923220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:20.948313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 138/277] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:20 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:20.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.959787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.013476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8641e-9173-49f6-851e-7b16633cdab0 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.054553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.055777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.056259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.056735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.069671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:21.077650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1040e6b-c35d-4e6b-bbe2-30e2bd239d7a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:21.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:21.079624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:21.080433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:21.083993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 140/278] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:21.093051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.115880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.116709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.117880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.117880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.130268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:21.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:21.139626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:21.140433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 139/279] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:21.146356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.146814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.219570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.234198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3eaa-229a-44f9-8c51-2f98712ef06d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.275003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7dfc-1e8c-4b79-aad6-6f69ea4fca51 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.284049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.285146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.286258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.286602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.287448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:21.287822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.289712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:21.299368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 141/280] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:21.304577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.322227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.322994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.323350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.323722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.324545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:21.325810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.326503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:21.336561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 140/281] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:21.342427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.434724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.445285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4ba23-1ce3-4f5d-8661-03a5d66cbd8e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.469201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cdc52-75dd-43bb-a643-7a48a931b124 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.494906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.496247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf18fac-c3e0-4ab8-858f-95719f3bee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.497826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18fac-c3e0-4ab8-858f-95719f3bee6d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.498365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18fac-c3e0-4ab8-858f-95719f3bee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.499213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf18fac-c3e0-4ab8-858f-95719f3bee6d None admin] PATH_INFO: `/v3/users/a15cbaa1b51c472aa8fedcf45076bb65` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.514694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.516595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.517083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.517618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf18fac-c3e0-4ab8-858f-95719f3bee6d None admin] RBAC: Authorizing `identity:get_user(user_id=a15cbaa1b51c472aa8fedcf45076bb65)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.518047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] PATH_INFO: `/v3/users/f21db4c7e87646609e9f60ec533efc72` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.519225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf18fac-c3e0-4ab8-858f-95719f3bee6d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:21.520260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] RBAC: Authorizing `identity:get_user(user_id=f21db4c7e87646609e9f60ec533efc72)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.521984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:21.522114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 142/282] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/users/a15cbaa1b51c472aa8fedcf45076bb65 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:21.524259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 141/283] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/users/f21db4c7e87646609e9f60ec533efc72 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:21.528699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0dcf9-12a8-4dbc-9225-f423f42b810e None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.528699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0dcf9-12a8-4dbc-9225-f423f42b810e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.528699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0dcf9-12a8-4dbc-9225-f423f42b810e None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.529900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.530289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 143/284] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:21.533660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0dcf9-12a8-4dbc-9225-f423f42b810e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.653913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eedf8b-04c4-4f90-bbd0-f13089070596 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.674971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0dcf9-12a8-4dbc-9225-f423f42b810e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.696069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.697177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.697852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.698346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.699926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, user.id=a15cbaa1b51c472aa8fedcf45076bb65, scope.system=all) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:21.700485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.702443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b245c7-e559-4577-a68a-6d68e222aee8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:21.708291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 142/285] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/role_assignments?user.id=a15cbaa1b51c472aa8fedcf45076bb65&scope.system=all&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:21.713839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.714129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.714469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.722983 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.725235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.725235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.725408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.730685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.732187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:21.737117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 144/286] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:21.742504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.743632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:21.745051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:21.788898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.836381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:21.865050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 143/287] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:21.885000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:21.928585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464ebcd-55cf-48f5-b166-da37d2e7e8bb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:21.965044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:21.965940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:21.966218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:21.966503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc/users/f21db4c7e87646609e9f60ec533efc72/roles/aeb7208c0c9a4b97ad2ad81d93210437` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:21.968483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e4f17634924aae91ae8465492529bc, user_id=f21db4c7e87646609e9f60ec533efc72, role_id=aeb7208c0c9a4b97ad2ad81d93210437)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:21.969959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:22.000617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e92cf-751b-4497-afd7-4aa502b052b2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:22.011571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 145/288] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:21 2022] PUT /identity/v3/projects/a6e4f17634924aae91ae8465492529bc/users/f21db4c7e87646609e9f60ec533efc72/roles/aeb7208c0c9a4b97ad2ad81d93210437 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:41:22.041915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:22.043131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:22.043618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:22.044093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:22.057577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:22.065951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:22.067738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:22.068552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:22.076152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 144/289] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:22.078023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:22.201633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:22.228754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452943fa-cd39-4a3a-bb60-97f2ed5393cc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:22.266857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:22.267750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:22.268178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:22.268595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:22.269550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:22.270593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:22.272128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:22.281089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 146/290] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:22.288125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:22.339549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:22.401049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a21744-dafa-4dc5-9ec7-4b024c813978 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:22.441211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:22.443496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:22.443932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:22.444349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] PATH_INFO: `/v3/users/494ca28821f04e7abda35b24221cd4a0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:22.445761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=494ca28821f04e7abda35b24221cd4a0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:22.447368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:22.449185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 145/291] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:22 2022] GET /identity/v3/users/494ca28821f04e7abda35b24221cd4a0 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:22.459185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:22.605748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ab20-dc32-40f6-b8a0-ce83093ba888 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:22.654583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:22.655240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:22.655519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:22.655792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:22.680206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:22.748469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:22.750026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:22.884768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 147/292] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:22.890236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:23.058591 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2cf1-5a51-4577-a585-d253c63d7bb0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:23.081993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:23.117055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a808-5033-4598-a4fa-f64c39a871be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:23.118295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a808-5033-4598-a4fa-f64c39a871be None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.118780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a808-5033-4598-a4fa-f64c39a871be None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.119253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a808-5033-4598-a4fa-f64c39a871be None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.125728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a808-5033-4598-a4fa-f64c39a871be None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:23.127487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a808-5033-4598-a4fa-f64c39a871be None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:23.130654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 146/293] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:22 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:23.136505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:23.208629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:23.279740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd5ad-01b5-4c99-af05-65822fd2842f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:23.322634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:23.323305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.323592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.323873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.324703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=494ca28821f04e7abda35b24221cd4a0) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:23.325041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:23.326497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf23e-4dca-4996-8791-4b9a2fd13610 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:23.333687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 148/294] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:23 2022] GET /identity/v3/role_assignments?user.id=494ca28821f04e7abda35b24221cd4a0&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:23.621187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae1de-2771-490b-a35e-0e81fc26831c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.622221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae1de-2771-490b-a35e-0e81fc26831c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.622708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae1de-2771-490b-a35e-0e81fc26831c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.624343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 147/295] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:23.630231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd7c5-259e-4805-b624-33d54e49688f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.631105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd7c5-259e-4805-b624-33d54e49688f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.631614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd7c5-259e-4805-b624-33d54e49688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.657949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1e7cd7c5-259e-4805-b624-33d54e49688f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:23.659494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1e7cd7c5-259e-4805-b624-33d54e49688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:23.747242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 149/296] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:23.774026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ae1de-2771-490b-a35e-0e81fc26831c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:23.820519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272bcf-b60f-4330-b551-dc8aeea66acf None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.821182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272bcf-b60f-4330-b551-dc8aeea66acf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.821662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272bcf-b60f-4330-b551-dc8aeea66acf None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.823502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 150/297] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:23.828787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.829386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.829867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.851758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:23.853310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:23.890020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:23.905894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ae1de-2771-490b-a35e-0e81fc26831c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:23.932954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 151/298] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:23.947691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:23.948495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.948776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.949098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.949436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:23.967287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:23.982939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:23.983854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:23.984661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 148/299] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:23.990894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.037310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:24.059886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df016b5-7ba5-4c74-99e5-428bf9c8b498 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.095977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.097096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.097583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.098042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.099499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:24.101121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:24.102133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f0f10-2538-44c5-9151-58d868e0a08b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.107742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 152/300] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:24.108783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.141214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.141969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.142351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.142819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.143777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:24.144304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:24.146708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfed86-a155-4faf-b03f-78cb65c89e20 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:24.153888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:24.156386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 149/301] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:24.162633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b173562-6040-483f-a18e-f1439a6b8976 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.162936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b173562-6040-483f-a18e-f1439a6b8976 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.163216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b173562-6040-483f-a18e-f1439a6b8976 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.164779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 150/302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:24.168817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b173562-6040-483f-a18e-f1439a6b8976 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.227947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b9771-bf35-48d6-b6a6-0140c399d14c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.265174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794e90e-aada-4398-abe6-43647ea09faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.265871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794e90e-aada-4398-abe6-43647ea09faf None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.266153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794e90e-aada-4398-abe6-43647ea09faf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.266615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794e90e-aada-4398-abe6-43647ea09faf None admin] PATH_INFO: `/v3/groups` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.267086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794e90e-aada-4398-abe6-43647ea09faf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:24.268527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794e90e-aada-4398-abe6-43647ea09faf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:24.274503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b173562-6040-483f-a18e-f1439a6b8976 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.277043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:24.296960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 153/303] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jul 5 20:41:24 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:24.296960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.296960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.296960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.313465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.314411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.314725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.315004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] PATH_INFO: `/v3/users/b0534a02870e41f3bea58bafd5111888` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.320549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:24.321840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:24.331793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] RBAC: Authorizing `identity:get_user(user_id=b0534a02870e41f3bea58bafd5111888)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:24.333839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:24.335618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 151/304] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/users/b0534a02870e41f3bea58bafd5111888 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:24.343127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.427459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 154/305] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:24.450581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.484638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e1f6-85f2-446e-aa18-7c11d2a22991 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.495575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:24.528316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.529544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.529992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.530276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.531384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] RBAC: Adding query filter params (role.id=aeb7208c0c9a4b97ad2ad81d93210437, user.id=b0534a02870e41f3bea58bafd5111888, scope.system=all) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:24.531700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:24.533554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214f40-1ab0-4694-9c7b-8104add11878 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:24.540766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 152/306] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/role_assignments?user.id=b0534a02870e41f3bea58bafd5111888&scope.system=all&role.id=aeb7208c0c9a4b97ad2ad81d93210437 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:24.591713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db1f9-2c82-428a-956c-ecc8b3b7bb39 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.632678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.633337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8c87-9604-4bf1-a942-4154c37c2928 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.633337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8c87-9604-4bf1-a942-4154c37c2928 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.633337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e8c87-9604-4bf1-a942-4154c37c2928 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.634688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 153/307] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:24.634931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.635352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.635834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.640177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.640473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.640755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.650062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:24.658438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:24.659625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:24.661152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:24.661801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:24.661801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:24.663917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 155/308] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:24.669914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.685476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:24.742367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 154/309] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:24.764997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.781335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:24.794845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa8ed7-2f59-40d7-bb4d-f62182d92e6e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.838137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.838816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.839098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.839370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.840122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:24.840425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:24.841852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:24.850857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 156/310] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:24.858469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.888998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81260415-4d30-4a35-a0ff-0b32f7430024 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.941155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:24.942167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:24.942447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:24.942719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:24.956711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:24.968555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:24.969508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:24.970975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:24.971738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a350f-5207-4fb1-8baa-32c2ecc0316a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:24.971825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 155/311] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:24.975729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:24.995843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:25.020028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.021560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.021842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.022114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] PATH_INFO: `/v3/users/a15cbaa1b51c472aa8fedcf45076bb65` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.023823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] RBAC: Authorizing `identity:get_user(user_id=a15cbaa1b51c472aa8fedcf45076bb65)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.025979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.028649 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 157/312] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/users/a15cbaa1b51c472aa8fedcf45076bb65 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:25.033800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:25.055848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:25.094695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75733b7-2554-477a-8233-3db04a7d667b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:25.141031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.141708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.141995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.142179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2489793-81c4-45a4-aef7-570d05524a6a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:25.142290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.143006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:25.143311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.145266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.158620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 156/313] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:25.164917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:25.181016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.181885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.182163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.182435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] PATH_INFO: `/v3/system/users/a15cbaa1b51c472aa8fedcf45076bb65/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.183903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a15cbaa1b51c472aa8fedcf45076bb65, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.185315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.196280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 158/314] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jul 5 20:41:25 2022] PUT /identity/v3/system/users/a15cbaa1b51c472aa8fedcf45076bb65/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:41:25.290772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:25.309865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31967bb-142f-43b5-a68d-dec09acc1a24 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:25.349080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.349972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.350253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.350528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] PATH_INFO: `/v3/users/f21db4c7e87646609e9f60ec533efc72` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.351815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f21db4c7e87646609e9f60ec533efc72)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.353291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.354925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 157/315] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:25 2022] GET /identity/v3/users/f21db4c7e87646609e9f60ec533efc72 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:25.360486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:25.452479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:25.471955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcb6a8-7cc7-45a1-84bc-f0a7511ec977 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:25.509608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.510270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.510556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.510838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.586394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.588680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.678634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:25.699745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:25.705479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:25.819442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70171d-3653-4da7-9cc1-85a0dcee90b9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:25.855025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2ca0a-657e-4f8e-a2e7-967dd52dccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.856571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2ca0a-657e-4f8e-a2e7-967dd52dccad None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.857259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2ca0a-657e-4f8e-a2e7-967dd52dccad None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.857685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2ca0a-657e-4f8e-a2e7-967dd52dccad None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.859039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2ca0a-657e-4f8e-a2e7-967dd52dccad None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.860610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2ca0a-657e-4f8e-a2e7-967dd52dccad None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.862787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 158/317] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:25 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:25.869128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:25.975101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aec5d-bcba-429a-b6a6-d350bed7b121 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:26.011755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:26.013005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.013489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.013973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.014993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] RBAC: Adding query filter params (role.id=aeb7208c0c9a4b97ad2ad81d93210437, scope.project.id=a6e4f17634924aae91ae8465492529bc, user.id=f21db4c7e87646609e9f60ec533efc72) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:26.015499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:26.017163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bd4e2-bd0f-4e23-a2ad-6037e2244d5b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:26.024052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 160/318] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:25 2022] GET /identity/v3/role_assignments?user.id=f21db4c7e87646609e9f60ec533efc72&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=aeb7208c0c9a4b97ad2ad81d93210437 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:26.513064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594d77-78f3-41d0-9f6d-ee4c442b3f29 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.513431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594d77-78f3-41d0-9f6d-ee4c442b3f29 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.513625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594d77-78f3-41d0-9f6d-ee4c442b3f29 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.515143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 159/319] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:26.520703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c9cf-3337-4171-a236-bf7422bbbaf3 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.521025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c9cf-3337-4171-a236-bf7422bbbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.521310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c9cf-3337-4171-a236-bf7422bbbaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.546019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d3c9c9cf-3337-4171-a236-bf7422bbbaf3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:26.547339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d3c9c9cf-3337-4171-a236-bf7422bbbaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:26.592541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:26.619360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 161/320] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:26.641865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594d77-78f3-41d0-9f6d-ee4c442b3f29 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:26.658115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:26.680151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209762-6e0d-4209-a511-d3a4eea2c28b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.681166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209762-6e0d-4209-a511-d3a4eea2c28b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.681447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b209762-6e0d-4209-a511-d3a4eea2c28b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.683761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 162/321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:26.688973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.688973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.689339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.708087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:26.709295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:26.762917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594d77-78f3-41d0-9f6d-ee4c442b3f29 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:26.783810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:26.802267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:26.803069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.803350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.803621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.804767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:26.806236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:26.806757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:26.812228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 160/323] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:26.813045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:26.906376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:26.912289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512d613-1114-4a8a-8ac9-347ef663ac27 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:26.921024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:26.929297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31819-b89a-4c92-8300-91f2d318ba50 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:26.950974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:26.951790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.952073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.952347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.963805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:26.965235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:26.965906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:26.966192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:26.966467 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] PATH_INFO: `/v3/groups` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:26.967158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:26.968604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:26.971557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:26.972415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:26.974237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 164/324] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:26.979551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:26.988156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 161/325] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jul 5 20:41:26 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:27.094151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d7ba-8d98-46fb-b9cc-f34f13ccf724 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:27.132147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:27.132837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.133149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.133430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.134181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:27.134487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:27.135912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:27.145244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 165/326] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:27.150962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:27.265346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2dd29-99d1-4e99-8151-6833929a81e1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:27.301844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617b2b-931b-4e4a-ac6c-b9efbba13045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:27.302742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617b2b-931b-4e4a-ac6c-b9efbba13045 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.303033 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617b2b-931b-4e4a-ac6c-b9efbba13045 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.303307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617b2b-931b-4e4a-ac6c-b9efbba13045 None admin] PATH_INFO: `/v3/users/b0534a02870e41f3bea58bafd5111888` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.304545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34617b2b-931b-4e4a-ac6c-b9efbba13045 None admin] RBAC: Authorizing `identity:get_user(user_id=b0534a02870e41f3bea58bafd5111888)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:27.306047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34617b2b-931b-4e4a-ac6c-b9efbba13045 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:27.308016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 162/327] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:27 2022] GET /identity/v3/users/b0534a02870e41f3bea58bafd5111888 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:27.313650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:27.346619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:27.361571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ee97b-74f3-4c36-a1c4-a0b23a86e672 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.361864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ee97b-74f3-4c36-a1c4-a0b23a86e672 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.362713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ee97b-74f3-4c36-a1c4-a0b23a86e672 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.364613 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 163/328] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:27.369822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.370109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.370384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.389856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:27.391355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:27.395938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:27.439694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6a7b3-f26e-4230-9738-93f38c2f9804 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:27.483736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:27.484609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.484891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.485202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] PATH_INFO: `/v3/system/users/b0534a02870e41f3bea58bafd5111888/roles/aeb7208c0c9a4b97ad2ad81d93210437` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.486128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 164/329] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:27.487038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b0534a02870e41f3bea58bafd5111888, role_id=aeb7208c0c9a4b97ad2ad81d93210437)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:27.488629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:27.497006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 166/330] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jul 5 20:41:27 2022] PUT /identity/v3/system/users/b0534a02870e41f3bea58bafd5111888/roles/aeb7208c0c9a4b97ad2ad81d93210437 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:27.527003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:27.644056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596fcd7-7bbb-4af4-b652-0c41b528a472 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:27.682211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:27.683028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.683306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.683574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.695031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:27.699030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:27.707392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:27.708327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:27.709619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 165/331] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:27.714855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:27.817382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:27.826807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c600ff-09c9-478a-85f2-cfff8bfc2637 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:27.881505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:27.882198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.882481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.882759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.883515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:27.883822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:27.885238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:27.897364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 167/332] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:27.903019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:28.019157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c93f-d28e-4155-a151-e8fb18dd2f5c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:28.066788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d755-d87b-4c30-bcf3-969bb7525986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:28.067681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d755-d87b-4c30-bcf3-969bb7525986 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.067966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d755-d87b-4c30-bcf3-969bb7525986 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.068242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d755-d87b-4c30-bcf3-969bb7525986 None admin] PATH_INFO: `/v3/users/a15cbaa1b51c472aa8fedcf45076bb65` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.069523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d755-d87b-4c30-bcf3-969bb7525986 None admin] RBAC: Authorizing `identity:get_user(user_id=a15cbaa1b51c472aa8fedcf45076bb65)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:28.071011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d755-d87b-4c30-bcf3-969bb7525986 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:28.073005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 166/333] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:27 2022] GET /identity/v3/users/a15cbaa1b51c472aa8fedcf45076bb65 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:28.078685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:28.205656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b038ecc-a795-4ad1-9cbe-5ac302ab9c34 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:28.247440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:28.248115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.248398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.248679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.249546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] RBAC: Adding query filter params (role.id=792cfc3478734abe8d0b3462c9e2a065, user.id=a15cbaa1b51c472aa8fedcf45076bb65, scope.system=all) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:28.249861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:28.251309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374256-5bcc-47e6-a9a9-e0b6bc39d9b0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:28.266821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 168/334] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 5 20:41:28 2022] GET /identity/v3/role_assignments?user.id=a15cbaa1b51c472aa8fedcf45076bb65&scope.system=all&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:29.656773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6924d-9f27-4576-9ecb-542a4e7ad99a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:29.656773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6924d-9f27-4576-9ecb-542a4e7ad99a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:29.656773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6924d-9f27-4576-9ecb-542a4e7ad99a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:29.657914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 167/335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:29.664062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:29.667664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:29.668189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:29.694752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:29.696317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:29.707828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:29.798624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 169/336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:29.841353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6924d-9f27-4576-9ecb-542a4e7ad99a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:29.928291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:29.975143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6924d-9f27-4576-9ecb-542a4e7ad99a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:30.021581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0a390-8f91-422d-a83b-5ae56e66c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:30.022399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a390-8f91-422d-a83b-5ae56e66c953 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.022684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a390-8f91-422d-a83b-5ae56e66c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.022959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a390-8f91-422d-a83b-5ae56e66c953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.039427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0a390-8f91-422d-a83b-5ae56e66c953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-a8e0a390-8f91-422d-a83b-5ae56e66c953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:30.047242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:30.048135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:30.048968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:30.053045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 168/337] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:30.054926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:30.079067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bcca7-709c-4748-80d2-97cd68e491bc None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.079412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bcca7-709c-4748-80d2-97cd68e491bc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.079629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bcca7-709c-4748-80d2-97cd68e491bc None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.081154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 169/338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:30.088030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.088326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.088602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.115915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:30.117152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:30.265645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 170/339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:30.268246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d1eb-d9e8-4280-914d-9baeff89b637 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:30.291819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:30.319471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:30.320161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.320447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.320724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.321515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:30.321822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:30.323936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:30.334736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 170/340] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:30.342290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:30.363457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:30.440286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:30.531657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337dd83-f0a4-4a8f-adb8-e0a4547d555e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:30.541038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698876-3c11-4c68-a55c-2aefbb3f6371 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:30.610381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:30.611201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.611486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.611768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.613553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4413fd-d945-45a9-97a0-0a7863b51ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:30.614211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4413fd-d945-45a9-97a0-0a7863b51ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.614493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4413fd-d945-45a9-97a0-0a7863b51ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.614770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4413fd-d945-45a9-97a0-0a7863b51ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.652018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:30.669140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:30.670528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:30.671339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:30.673876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:30.680027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:30.766483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4413fd-d945-45a9-97a0-0a7863b51ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:30.768159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4413fd-d945-45a9-97a0-0a7863b51ad7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:30.784538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:30.893589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23be78f-1692-4978-9fe9-875723995cc2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:30.918546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:30.932975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 171/342] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:30.934357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed93a2-5676-4e94-9427-aef5ac67bd3d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.934648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed93a2-5676-4e94-9427-aef5ac67bd3d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.934924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed93a2-5676-4e94-9427-aef5ac67bd3d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.936306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 172/343] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:30.937595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe61de-29bb-4a6d-8364-a8133c57016b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.938277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe61de-29bb-4a6d-8364-a8133c57016b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.938699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe61de-29bb-4a6d-8364-a8133c57016b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.940395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 173/344] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:30.941457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe61de-29bb-4a6d-8364-a8133c57016b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:30.946070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:30.947005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.947458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.947881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.948822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:30.949546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:30.952146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14702-b0ae-4073-b9c1-8f7f6326f29b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:30.963924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 172/345] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:30.966073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d4ae-f414-4391-b37a-2d41b0a029dd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:30.966817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d4ae-f414-4391-b37a-2d41b0a029dd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:30.967277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d4ae-f414-4391-b37a-2d41b0a029dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:30.989382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5308d4ae-f414-4391-b37a-2d41b0a029dd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:30.995572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5308d4ae-f414-4391-b37a-2d41b0a029dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:31.069586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 173/346] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:31.071180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.071647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.072100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.081611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe61de-29bb-4a6d-8364-a8133c57016b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:31.097263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.102807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:31.104000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:31.135343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:31.136524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.137041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.137588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.139085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:31.140912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:31.143152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 174/347] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:30 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:31.144160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.187045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:31.187452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.235604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.268924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22e733-2d72-4bfc-b20a-ec2dfc6356f4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:31.302721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc34aa-9655-472d-8be0-4f5a75a4035f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:31.314079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:31.314975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.315393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.315800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.354149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c615a3-ba4a-4bde-b4f6-2ee1a612563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:31.355100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c615a3-ba4a-4bde-b4f6-2ee1a612563f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.355386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c615a3-ba4a-4bde-b4f6-2ee1a612563f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.355659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c615a3-ba4a-4bde-b4f6-2ee1a612563f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.368154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c615a3-ba4a-4bde-b4f6-2ee1a612563f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:31.373504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-22c615a3-ba4a-4bde-b4f6-2ee1a612563f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:31.376150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:31.377203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:31.378028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 175/349] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:31.379689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455bc26-b4f9-43af-b58a-aad1c71d01d7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.380098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455bc26-b4f9-43af-b58a-aad1c71d01d7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.380394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455bc26-b4f9-43af-b58a-aad1c71d01d7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.386459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 176/350] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:31.387080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455bc26-b4f9-43af-b58a-aad1c71d01d7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.418010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:31.419801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:31.525563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.533204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455bc26-b4f9-43af-b58a-aad1c71d01d7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:31.547825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 175/351] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:31.548700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.585276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:31.586167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.586415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.586685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.598286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:31.599965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:31.602191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 177/352] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:31.603113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.639867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.684473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816156f2-5fb2-4729-bdac-7bea9abbeef6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:31.730580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d23428-acd2-459c-8e6c-2e7d0f4871f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:31.731647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23428-acd2-459c-8e6c-2e7d0f4871f5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.732066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23428-acd2-459c-8e6c-2e7d0f4871f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.732485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d23428-acd2-459c-8e6c-2e7d0f4871f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.744873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d23428-acd2-459c-8e6c-2e7d0f4871f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:31.747488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65a021-40d7-4528-8aa0-5707342f5d31 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f9d23428-acd2-459c-8e6c-2e7d0f4871f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:31.752761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:31.753754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:31.754746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 176/353] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:31.755421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.755421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.756389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.789468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:31.789468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:31.811894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:31.812674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:31.813599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:31.813958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:31.815079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:31.815456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:31.818431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:31.830903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 178/354] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:31.833305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.870309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 177/355] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:31.871310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:31.875045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.956418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:31.970363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08459-4962-4976-9b6c-d8fb8d50762d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.012584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe78c9-3048-46a6-8930-3738d80ddcaa None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.013581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.014445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.015284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.015284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.016217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.017700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.019498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 179/356] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:32.020223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.054132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.054797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.055079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.055355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.056170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=013b61df053d44f4935205044229122a) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:32.056479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.057967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.063761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 178/357] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:31 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=013b61df053d44f4935205044229122a&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:32.066734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.149699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:32.160823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc2f6-a246-4880-bf44-86714b21cfbf None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.212194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.213040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.213160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.213368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.214235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:32.214415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.216907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.228074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 180/358] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:32.228409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be64f0c-7b02-4a6e-a7c7-78733da237df None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.228917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.269707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:32.280320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf86b2-f3e1-486b-a82f-419359943fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.281407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf86b2-f3e1-486b-a82f-419359943fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.281671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf86b2-f3e1-486b-a82f-419359943fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.281943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf86b2-f3e1-486b-a82f-419359943fe4 None admin] PATH_INFO: `/v3/users/b0534a02870e41f3bea58bafd5111888` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.283152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf86b2-f3e1-486b-a82f-419359943fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=b0534a02870e41f3bea58bafd5111888)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.284859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf86b2-f3e1-486b-a82f-419359943fe4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.286729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 179/359] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/users/b0534a02870e41f3bea58bafd5111888 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:32.289221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509a077-4f8d-47a0-beae-42745b99549f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.289439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509a077-4f8d-47a0-beae-42745b99549f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.289713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509a077-4f8d-47a0-beae-42745b99549f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.290961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 180/360] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:32.291712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509a077-4f8d-47a0-beae-42745b99549f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.350835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26766e8-5c2b-467e-aca3-ade3c072871a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.391913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.392737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.393076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.393374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.405530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:32.415843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:32.416778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:32.417659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 181/361] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:32.418335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.419859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509a077-4f8d-47a0-beae-42745b99549f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.439697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:32.464811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.465621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.465903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.466177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.467411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.468855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.470666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 181/362] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:32.471317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.548810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5f036-cc61-40fe-93e1-35596b50578e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.556868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:32.600148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.600823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.601215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.601648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.610347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708c9f1-e7cb-4491-a2e3-7c1f7410b9a5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.653825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.654593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.654885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.655165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.656101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] RBAC: Adding query filter params (role.id=aeb7208c0c9a4b97ad2ad81d93210437, user.id=b0534a02870e41f3bea58bafd5111888, scope.system=all) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:32.656475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.658063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473c13-9dae-475e-83db-e6c501647e51 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.673010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 182/363] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/role_assignments?user.id=b0534a02870e41f3bea58bafd5111888&scope.system=all&role.id=aeb7208c0c9a4b97ad2ad81d93210437 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:32.674684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.675118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.675444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.691085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.693362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.697171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:32.698069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:32.745457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:32.792102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 183/364] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:32.793040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.864875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 182/365] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:32.866570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.891854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:32.966038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940759b3-3fe2-4001-9d84-122d8d01b26a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.002114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e2c1-2f97-49c0-adc9-83492e69ed88 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.012439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.014723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.015011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.015290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.016468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:33.017135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.018786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.022803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.032090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 184/366] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:33.032876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.045385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.046443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.046885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.047290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.048136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=013b61df053d44f4935205044229122a) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:33.048617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.051150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.058019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 183/367] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=013b61df053d44f4935205044229122a&role.id=ce695803124649b4ad62ca6ec15c935e => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:33.059045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.154790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730817-1126-46d8-a200-6e0c0d6f7faf None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.170256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.197139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2602-ecd6-4a7c-9112-e395e7372ca6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.202829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.203647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.203930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.204204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.219838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:33.232200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:33.233508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 185/368] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:33.234359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.246661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.247956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.248443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.248921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.250495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.252278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.255034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 184/369] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:33.256142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.321568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.376201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc6ab-366a-4f6e-b0cb-6eaea0b856f5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.378333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1637-7db7-4a06-9af0-33ff44d5ec63 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.414191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.414813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.415093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.415366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.419129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.420133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.420619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.421178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.422129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:33.422641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.424210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.433804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 185/370] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:33.434907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.464140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.493810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.495308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.581381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf85189-54bf-47a4-a9c6-3ea81434ac1c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.593800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.620887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.621837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.622055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.622333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.624624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.625231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 186/371] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:33.626353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.626731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.628129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 186/372] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:33.633733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.707694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.758704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e298b-fa49-448b-a5f0-e3e09092f95a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.759865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5b852-efc6-471b-bb80-5d0b95397f44 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:33.804331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.805481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.805911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.806182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.807376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.808831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.810553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 187/373] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:33.811299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:33.811832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:33.813050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:33.813509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:33.813958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:33.888176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:33.918325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:33.920959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:33.962867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e71b-a027-437d-a8d7-e8c986407328 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.007178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.008211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.008890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.009361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.011035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=a6e4f17634924aae91ae8465492529bc) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:34.011515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.013146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.021614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:34.023256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 188/374] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:34.024303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.058852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 187/375] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:34.063998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.170766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6016c4-5901-43e9-a5d9-f940d6f43948 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.186673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:34.188561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad723e-3568-4383-a128-fd14d4ed12cf None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.229346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.230710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.231138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.231647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.233065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.233385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.233784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.234142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.234280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] PATH_INFO: `/v3/projects/bc03931f4286458d988d48dd2cd6c224` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.236007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.236651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] RBAC: Authorizing `identity:get_project(project_id=bc03931f4286458d988d48dd2cd6c224)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.238674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 189/376] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:34.239138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.241192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 188/377] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/projects/bc03931f4286458d988d48dd2cd6c224 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:34.244856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.246585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.293366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:34.357301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb87004-cc99-4340-9d44-dcce38cc44bf None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.368392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906467ae-077e-4ab2-95fb-23badd1a2ba6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.399166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.400146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.400501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.401082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] PATH_INFO: `/v3/groups/97b1e1d58af245a2b65535c423872a5b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.409396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] RBAC: Authorizing `identity:get_group(group_id=97b1e1d58af245a2b65535c423872a5b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.411066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.413999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.414998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.415489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.415984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.417043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=a6e4f17634924aae91ae8465492529bc) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:34.417558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.418432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 189/378] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/groups/97b1e1d58af245a2b65535c423872a5b => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:34.419292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.419799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0475595-6937-461f-ad73-9f5fe4ea8164 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.427137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 190/379] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=ce695803124649b4ad62ca6ec15c935e => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:34.479266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f89d-abd0-44f1-bf04-1d59a66a4846 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.479957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f89d-abd0-44f1-bf04-1d59a66a4846 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.480433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26f89d-abd0-44f1-bf04-1d59a66a4846 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.483441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 191/380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:34.489941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.490669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.491193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.510247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:34.512030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:34.532161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f4fb6-2cb0-491c-a0d9-5a39560ee83e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.534860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:34.575269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.575959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.576249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.576531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.577514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] RBAC: Adding query filter params (group.id=97b1e1d58af245a2b65535c423872a5b, role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=bc03931f4286458d988d48dd2cd6c224) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:34.577790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.579334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.583443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:34.586036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 190/381] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/role_assignments?group.id=97b1e1d58af245a2b65535c423872a5b&scope.project.id=bc03931f4286458d988d48dd2cd6c224&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:34.617124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 192/382] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:34.639717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.770542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5de04-4b1f-4aa0-9093-94683dc98d15 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.806859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.807664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.807950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.808228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.819681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:34.827446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:34.828310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:34.829144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 191/383] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:34.835240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.984891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157c2dd-8f7e-46e0-8d70-7bb6bf4c64af None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:35.028696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:35.029737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:35.030231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:35.030710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:35.031652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] RBAC: Adding query filter params (name=member) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:35.032164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:35.033772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:35.048772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 193/384] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:35.054383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:35.113351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:35.191200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821878ae-16a0-4a0a-a82f-a2045c26f539 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:35.227627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:35.228497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:35.228779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:35.229085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:35.230266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:35.231730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:35.233810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:35 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:35.242226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:35.308859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:35.407087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c63857-759e-476f-9c4d-bdfd2a3b622e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:35.457479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56332f6-30ab-4828-a9c6-e5d40e7923f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:35.458342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56332f6-30ab-4828-a9c6-e5d40e7923f0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:35.458623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56332f6-30ab-4828-a9c6-e5d40e7923f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:35.458896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56332f6-30ab-4828-a9c6-e5d40e7923f0 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:35.465653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56332f6-30ab-4828-a9c6-e5d40e7923f0 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:35.467099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56332f6-30ab-4828-a9c6-e5d40e7923f0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:35.468784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:35 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:35.475201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:35.673373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:35.683022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fe30c-8055-44ab-a945-5114cbce72f2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:35.792181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea241-b7e6-44c5-9a29-e6fb9f346f88 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:35.792523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea241-b7e6-44c5-9a29-e6fb9f346f88 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:35.792737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea241-b7e6-44c5-9a29-e6fb9f346f88 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:35.794122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 195/387] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:35.797619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:35.798737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:35.799230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:35.799713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a/groups/5dd933b06991445492c84396c65ce175/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:35.804048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=013b61df053d44f4935205044229122a, group_id=5dd933b06991445492c84396c65ce175, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:35.804260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:35.804511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:35.804784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:35.806340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:35.823030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 193/388] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 5 20:41:35 2022] PUT /identity/v3/projects/013b61df053d44f4935205044229122a/groups/5dd933b06991445492c84396c65ce175/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:35.866230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:35.867450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:36.029289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 196/389] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:36.058333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:36.179192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89365-d572-4395-9466-7889e3c75fa2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:36.220919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:36.222897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.223868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.224441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.236598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:36.246235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:36.247112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:36.247924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:36.251237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 194/390] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:36.258178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:36.325286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:36.429284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50cb0-3f0e-4711-b83b-32969273b4cc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:36.466294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:36.467496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.467974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.468449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.469424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:36.469925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:36.471609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:36.481458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 197/391] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:36.489990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:36.519956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:36.603165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c687f-d8a9-460b-be0b-3e9a5957c10b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:36.638850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:36.639706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.639985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.640255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.641447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:36.642887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:36.645428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 195/392] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:36 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:36.654022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:36.777883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:36.785697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a42696-45bc-4aa2-9a0c-17e0b89aa8e6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:36.821322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2457139-7e36-4bb8-ac1b-3729a8cee8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:36.822184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457139-7e36-4bb8-ac1b-3729a8cee8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.822466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457139-7e36-4bb8-ac1b-3729a8cee8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.822741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457139-7e36-4bb8-ac1b-3729a8cee8b9 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.823925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2457139-7e36-4bb8-ac1b-3729a8cee8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:36.825619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2457139-7e36-4bb8-ac1b-3729a8cee8b9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:36.827610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:36 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:36.833571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:36.940817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:36.960534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122b683-560f-4e02-a418-a4695b38613e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:36.999602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89164-4b01-4ba4-b7bf-81927fbc2a1f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.999915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89164-4b01-4ba4-b7bf-81927fbc2a1f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.000198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c89164-4b01-4ba4-b7bf-81927fbc2a1f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.001724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 199/394] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:37.009260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.010145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.010423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.010693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a/groups/5dd933b06991445492c84396c65ce175/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.013030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839e70-e323-4d3e-a264-70fa9c477ae0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.013147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] RBAC: Authorizing `identity:create_grant(project_id=013b61df053d44f4935205044229122a, group_id=5dd933b06991445492c84396c65ce175, role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:37.013346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839e70-e323-4d3e-a264-70fa9c477ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.013586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839e70-e323-4d3e-a264-70fa9c477ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.014490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:37.038058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d5839e70-e323-4d3e-a264-70fa9c477ae0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:37.039945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d5839e70-e323-4d3e-a264-70fa9c477ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:37.047391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 196/395] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 5 20:41:36 2022] PUT /identity/v3/projects/013b61df053d44f4935205044229122a/groups/5dd933b06991445492c84396c65ce175/roles/ce695803124649b4ad62ca6ec15c935e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:37.161324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 200/396] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:37.210574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.302162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916453d6-5b3e-4c1b-bb8b-0cf078ad8330 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.302793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916453d6-5b3e-4c1b-bb8b-0cf078ad8330 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.303305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916453d6-5b3e-4c1b-bb8b-0cf078ad8330 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.305187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 201/397] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:37.310228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21f6e-03b9-447c-8109-b03cd3c90bd2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.310759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21f6e-03b9-447c-8109-b03cd3c90bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.311255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c21f6e-03b9-447c-8109-b03cd3c90bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.330589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-48c21f6e-03b9-447c-8109-b03cd3c90bd2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:37.332610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-48c21f6e-03b9-447c-8109-b03cd3c90bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:37.342341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4bcc0-3232-454a-8a70-2ab5b48ab466 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:37.378496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0614ff-874e-4de1-901b-f1f4dee9af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.380065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0614ff-874e-4de1-901b-f1f4dee9af9e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.380065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0614ff-874e-4de1-901b-f1f4dee9af9e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.380065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0614ff-874e-4de1-901b-f1f4dee9af9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.392634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0614ff-874e-4de1-901b-f1f4dee9af9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-9a0614ff-874e-4de1-901b-f1f4dee9af9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:37.410584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:37.411773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 197/398] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:37.412718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8f661-0d22-4919-9ae9-d994116f3a59 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.413878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8f661-0d22-4919-9ae9-d994116f3a59 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.413878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8f661-0d22-4919-9ae9-d994116f3a59 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.418266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 198/399] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:37.418266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8f661-0d22-4919-9ae9-d994116f3a59 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.421171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:37.438094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 202/400] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:37.439923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.440312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.440687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.460238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:37.461565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:37.481542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:37.549045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 203/401] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:37.551410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.562669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8f661-0d22-4919-9ae9-d994116f3a59 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:37.611348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.612030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.612314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.612588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.613924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:37.614756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:37.616472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:37.628775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 199/402] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:37.629744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.673843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc534828-bc4a-4398-b932-f330af925ff4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:37.712560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:37.719229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.720840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.721150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.721428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.733249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:37.741864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:37.742783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:37.743593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:37.747881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 204/403] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:37.748779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.753584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b8109-5691-4e9d-b73b-17ea88355f76 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:37.765145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:37.790467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.791626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.792134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.792624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.804379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:37.812698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:37.813754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:37.814694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:37.817260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 200/404] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:37.818278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.863246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93caaf-7b25-4624-956c-0210d7812517 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:37.901571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.902870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.903097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.903506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.904898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:37.906942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:37.908574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 205/405] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:37.909446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:37.923580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854d40a-6c99-461c-a6a1-7dc8ba43c40f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:37.951490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:37.961545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:37.962507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:37.963032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:37.963512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:37.964472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:37.965074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:37.966647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:37.976421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 201/406] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:37.977644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.017414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:38.040886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e24c-2275-44fe-a32a-0994f9d9c71f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.079017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.079687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.080016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.080296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.081164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:38.081529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.083587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.091425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b12f41-2bde-49ed-97da-253965b762dc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.092473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 206/407] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:38.093488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.127219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.129088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.129568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.130033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.131571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.133250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.135761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 202/408] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:37 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:38.136799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.196383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:38.208168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e973ee-e2d4-410f-923b-f184768ccaa4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.245263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.246515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.247139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.247560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] PATH_INFO: `/v3/groups/97b1e1d58af245a2b65535c423872a5b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.248989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] RBAC: Authorizing `identity:get_group(group_id=97b1e1d58af245a2b65535c423872a5b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.250832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.252497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdd484-7b0d-41c6-a87e-1cf1ba5fe80b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.257284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 207/409] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:38 2022] GET /identity/v3/groups/97b1e1d58af245a2b65535c423872a5b => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:38.258313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.273710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:38.293785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.294979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.295576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.296044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.297709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.299551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.302516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 203/410] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:38 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:38.303614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.381474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c986f-afb3-4cf9-a4c0-279186c231a3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.415836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1aef1f-32b4-4f64-b9c7-f818769b5914 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.420221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.421345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.421790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.422208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc/groups/5dd933b06991445492c84396c65ce175/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.424421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e4f17634924aae91ae8465492529bc, group_id=5dd933b06991445492c84396c65ce175, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.426825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.442087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:38.444479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 208/411] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 5 20:41:38 2022] PUT /identity/v3/projects/a6e4f17634924aae91ae8465492529bc/groups/5dd933b06991445492c84396c65ce175/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:38.445655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.454992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.456099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.457021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.457416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] PATH_INFO: `/v3/projects/bc03931f4286458d988d48dd2cd6c224` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.459249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] RBAC: Authorizing `identity:get_project(project_id=bc03931f4286458d988d48dd2cd6c224)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.460731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.462936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 204/412] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:38 2022] GET /identity/v3/projects/bc03931f4286458d988d48dd2cd6c224 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:38.468471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.555048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:38.590636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e415d36-a7e8-4510-a17a-3f998e4047b3 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.598087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345b4ac-359f-47a9-bf0c-01933aaa999a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.632677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.633680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.634030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.634390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] PATH_INFO: `/v3/projects/bc03931f4286458d988d48dd2cd6c224/groups/97b1e1d58af245a2b65535c423872a5b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.636488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] RBAC: Authorizing `identity:create_grant(project_id=bc03931f4286458d988d48dd2cd6c224, group_id=97b1e1d58af245a2b65535c423872a5b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.638043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.639330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747683cb-dd34-4282-9c02-233d3ae7c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.640194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747683cb-dd34-4282-9c02-233d3ae7c323 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.640485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747683cb-dd34-4282-9c02-233d3ae7c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.640755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747683cb-dd34-4282-9c02-233d3ae7c323 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.642132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747683cb-dd34-4282-9c02-233d3ae7c323 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.643715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747683cb-dd34-4282-9c02-233d3ae7c323 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.646180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 209/413] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:38 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:38.647419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b709-5a0e-48e1-989b-91091ed8d9d4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.647663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b709-5a0e-48e1-989b-91091ed8d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.647964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b709-5a0e-48e1-989b-91091ed8d9d4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.649558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 210/414] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:38.654843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.655220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.655408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.656102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 205/415] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 5 20:41:38 2022] PUT /identity/v3/projects/bc03931f4286458d988d48dd2cd6c224/groups/97b1e1d58af245a2b65535c423872a5b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:41:38.661553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.675358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:38.677072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:38.750779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:38.824860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 211/416] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:38.867237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405dbe-fcf7-4f86-8190-dafa57f4f61d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.877446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.910511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.911497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.911776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.912048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc/groups/5dd933b06991445492c84396c65ce175/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.914870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6e4f17634924aae91ae8465492529bc, group_id=5dd933b06991445492c84396c65ce175, role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.916407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.936954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 206/417] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 5 20:41:38 2022] PUT /identity/v3/projects/a6e4f17634924aae91ae8465492529bc/groups/5dd933b06991445492c84396c65ce175/roles/ce695803124649b4ad62ca6ec15c935e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:38.976319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:39.021332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cf66-715e-4da0-8a0f-167c7c03629d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:39.064985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c102a-db0c-46a7-aec7-ded1fd11e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:39.066672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c102a-db0c-46a7-aec7-ded1fd11e410 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:39.067190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c102a-db0c-46a7-aec7-ded1fd11e410 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:39.067667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c102a-db0c-46a7-aec7-ded1fd11e410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:39.083085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c102a-db0c-46a7-aec7-ded1fd11e410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-602c102a-db0c-46a7-aec7-ded1fd11e410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:39.091887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:39.092893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:39.093926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:39.101059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 212/418] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:39.106112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:39.263883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b891558-a617-4f6a-bf6f-40886492a565 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:39.278226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:39.305121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:39.305856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:39.306138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:39.306409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:39.307489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:39.307894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:39.309975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:39.320956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 207/419] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:39.324287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95a2a-55a2-4a82-8caa-42078ce9a399 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:39.324581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95a2a-55a2-4a82-8caa-42078ce9a399 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:39.324861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95a2a-55a2-4a82-8caa-42078ce9a399 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:39.326510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 213/420] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:39.326650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:39.332645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:39.333618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:39.334413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:39.353584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:39.355161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:39.466527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 214/421] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:39.510918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:39.529615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b804-bca3-45dd-895f-21ee6758f7aa None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:39.579356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:39.580462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:39.580965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:39.581497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:39.638797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:39.667803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:39.669902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:39.707463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:39.799365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee038bc-8865-4a93-ab3a-f044916ba98b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:39.855499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 208/422] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:39.864710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:39.872691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:39.873718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:39.874132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:39.874589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:39.886037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:39.895051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:39.895962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:39.896826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:39.899452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 215/423] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:39.905505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:40.009289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:40.067901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506bf9d-f2ad-4674-beb7-f245276cd9ec None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:40.070076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c6da-4308-4bea-b457-51eb2bd36bae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:40.093862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:40.118622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:40.119529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:40.119963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:40.120422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:40.121396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:40.122846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:40.125143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:40.138469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:40.139575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:40.141942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:40.142376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:40.143740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:40.150714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:40.150907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 216/424] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:40.151910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:40.156494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 209/425] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:39 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:40.163269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:40.281988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4d974-405f-4b21-b219-97eb4fbb530c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:40.354886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2a28-6e3a-4bef-b727-9c3681c3d08c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:40.363184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:40.363849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:40.364135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:40.364412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:40.393997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:40.395141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:40.395583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:40.396013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:40.397889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:40.400032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:40.403222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 210/426] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:40 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:40.411287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:40.436755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:40.440333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:40.462380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:40.463957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:40.572438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 217/427] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:40.579192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:40.686148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0adac-6c55-45f0-b62c-64fc1ccf1b36 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:40.729364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:40.749096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eb19-78d5-4635-95a0-3bb0e249b0c1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:40.786815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:40.787491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:40.787773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:40.788047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:40.789160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=013b61df053d44f4935205044229122a) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:40.789471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:40.790929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:40.802888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 211/428] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:40 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=013b61df053d44f4935205044229122a&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 611 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:40.813991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717d4c2-59bb-4b65-bf7b-06d80c5a5b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:40.814922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d4c2-59bb-4b65-bf7b-06d80c5a5b9b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:40.815212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d4c2-59bb-4b65-bf7b-06d80c5a5b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:40.815487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d4c2-59bb-4b65-bf7b-06d80c5a5b9b None admin] PATH_INFO: `/v3/projects/013b61df053d44f4935205044229122a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:40.817310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717d4c2-59bb-4b65-bf7b-06d80c5a5b9b None admin] RBAC: Authorizing `identity:get_project(project_id=013b61df053d44f4935205044229122a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:40.818759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717d4c2-59bb-4b65-bf7b-06d80c5a5b9b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:40.820819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 218/429] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:40 2022] GET /identity/v3/projects/013b61df053d44f4935205044229122a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:40.826017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:40.952523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:40.992853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6f5e7-265e-43b4-9b92-0a830b7cd263 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.038074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.039991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.040476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.040972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.042405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:41.044078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:41.046335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 212/430] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:40 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:41.053055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4ef8-2123-46a5-8ec6-b7a6e726fd8e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.053055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4ef8-2123-46a5-8ec6-b7a6e726fd8e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.053266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.053340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b4ef8-2123-46a5-8ec6-b7a6e726fd8e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.054084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 219/431] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:41.058991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.059518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.059996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.085300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:41.087892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:41.184314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 220/432] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:41.204447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0c23f-0b0d-4696-8eb8-d16c8a4c093d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.210465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.247829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.248489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.248766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.249137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.249928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=013b61df053d44f4935205044229122a) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:41.250298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:41.251733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2e25-e2cf-45fd-9fd7-d91d568d2430 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:41.259253 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 213/433] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=013b61df053d44f4935205044229122a&role.id=ce695803124649b4ad62ca6ec15c935e => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:41.307422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0b66-7fad-461f-b668-60e82095a52c None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.307882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0b66-7fad-461f-b668-60e82095a52c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.308228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0b66-7fad-461f-b668-60e82095a52c None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.313713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 214/434] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:41.315942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:41.323312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.323678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.323957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.341688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:41.349224 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:41.350432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:41.350740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1489a-ac20-482a-bfb6-e3f2d09873a6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.401488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.403101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.403607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.404560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.421692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:41.432214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 215/435] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:41.432672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:41.433816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:41.435037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 221/436] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:41.439897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.458490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.575923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129c85f-ba09-4c15-bbb1-ead2eb4ab9df None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.592406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33cf4-f00d-443d-bccf-d930e6762fa7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.618191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.618874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.619153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.619429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.620175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:41.620794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:41.621945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caca404-d787-471b-8d97-9049f3ae3d22 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:41.624578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:41.631806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 216/437] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:41.633351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b898f0-5ce1-43d7-998e-d8989c936fe6 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.633634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b898f0-5ce1-43d7-998e-d8989c936fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.633913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b898f0-5ce1-43d7-998e-d8989c936fe6 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.635298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 217/438] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:41.637966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b898f0-5ce1-43d7-998e-d8989c936fe6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.647604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665446-2c07-4f57-a639-a201a7d6a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.648563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665446-2c07-4f57-a639-a201a7d6a3ae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.648894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665446-2c07-4f57-a639-a201a7d6a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.649271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665446-2c07-4f57-a639-a201a7d6a3ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.657079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:41.662165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665446-2c07-4f57-a639-a201a7d6a3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d1665446-2c07-4f57-a639-a201a7d6a3ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:41.670330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:41.671232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:41.672057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 222/439] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:41.672719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.673997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.674700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.692688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:41.693914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:41.767394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b898f0-5ce1-43d7-998e-d8989c936fe6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.779059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 223/440] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:41.779808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.806001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.806659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.806936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.807206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.873341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:41.877652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:41.879158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:41.881221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941c437-3cef-4d7c-b2a7-f9a10cd6b53c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.906641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:41.915744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.916408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.916689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.916994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.917735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:41.918131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:41.919498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:41.928561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 224/441] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:41.929471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.984132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 218/442] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:41.985134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.031095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ac05a-17d7-4ee3-9593-e21d7e6be020 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.064899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.066349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.066629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.066899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.076974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:42.079535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.083440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575e95-dbf7-4236-bfd2-20ce6c28115b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:42.085834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:42.087140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 225/443] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:42.087962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.119852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.120503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.120786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.121099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.138458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.190421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748c31f-14fa-4a4c-b292-67d52cc8304c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.192104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.194636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.229526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.230379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.230659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.230931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.232113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.233579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.235259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 226/444] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.237766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.290117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.294749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 219/445] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:42.295572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.348904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0dd78-3f95-4f13-af66-fd9c6268ae97 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.366293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.385418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.386084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.386363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.386637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.387559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:42.387865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.389268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.397562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 227/446] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.398332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.399854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237534b-8c73-48eb-bef0-e63dfe46a230 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.434903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.435761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.436042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.436314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.437502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.439341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.442373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 220/447] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.443129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.501653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb71791-92f6-43e4-94a8-ed2ac25b8ba4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.510284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.534949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.535812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.536097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.536379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] PATH_INFO: `/v3/projects/bc03931f4286458d988d48dd2cd6c224` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.537578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] RBAC: Authorizing `identity:get_project(project_id=bc03931f4286458d988d48dd2cd6c224)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.539293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.545399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 228/448] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/projects/bc03931f4286458d988d48dd2cd6c224 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.545399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.549265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d1fe-f375-43a3-a3a1-c3fc58fad50d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.583397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.584034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.584317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.584587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.590270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.644531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6d11-e953-4665-b357-d874b09c0d80 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.653713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.655648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.678709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.679357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.679643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.679920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.680740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=792cfc3478734abe8d0b3462c9e2a065, scope.project.id=a6e4f17634924aae91ae8465492529bc) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:42.681083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.682506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.688209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 229/449] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=792cfc3478734abe8d0b3462c9e2a065 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.689040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.729523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.775203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 221/450] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:42.780462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.816084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2be1c4-57d8-4fa8-a7d2-d941e3d1fda4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.830901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:42.861212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.862086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.862370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.862770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] PATH_INFO: `/v3/groups/97b1e1d58af245a2b65535c423872a5b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.863851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] RBAC: Authorizing `identity:get_group(group_id=97b1e1d58af245a2b65535c423872a5b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.865687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.866958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 230/451] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/groups/97b1e1d58af245a2b65535c423872a5b => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.874003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.895226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec8f3-53e7-42c7-b424-ac6d7681f104 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:42.937885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:42.938299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:42.938584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:42.938861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] PATH_INFO: `/v3/projects/a6e4f17634924aae91ae8465492529bc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:42.941376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] RBAC: Authorizing `identity:get_project(project_id=a6e4f17634924aae91ae8465492529bc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:42.942838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:42.944860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 222/452] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/projects/a6e4f17634924aae91ae8465492529bc => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:42.949981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:42.990783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:43.008400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33bbeb-4fec-4733-ae27-b6d39482f5b4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:43.055363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:43.056021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:43.056304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:43.056651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:43.057545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] RBAC: Adding query filter params (group.id=97b1e1d58af245a2b65535c423872a5b, role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=bc03931f4286458d988d48dd2cd6c224) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:43.057856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:43.059358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:43.066707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 231/453] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/role_assignments?group.id=97b1e1d58af245a2b65535c423872a5b&scope.project.id=bc03931f4286458d988d48dd2cd6c224&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:43.067785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed7e2-f254-425e-aa49-cdbc0eb30c43 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:43.105220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfda1e-546b-43ca-b4b2-f62a1dc0355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:43.106095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfda1e-546b-43ca-b4b2-f62a1dc0355f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:43.106381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfda1e-546b-43ca-b4b2-f62a1dc0355f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:43.106656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfda1e-546b-43ca-b4b2-f62a1dc0355f None admin] PATH_INFO: `/v3/groups/5dd933b06991445492c84396c65ce175` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:43.107879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfda1e-546b-43ca-b4b2-f62a1dc0355f None admin] RBAC: Authorizing `identity:get_group(group_id=5dd933b06991445492c84396c65ce175)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:43.109384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfda1e-546b-43ca-b4b2-f62a1dc0355f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:43.111075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 223/454] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 5 20:41:42 2022] GET /identity/v3/groups/5dd933b06991445492c84396c65ce175 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:43.117870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:43.166612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:43.224263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7c3a8-ac87-42fd-99ef-e689015ba62f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:43.259411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:43.260072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:43.260354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:43.260630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:43.261497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] RBAC: Adding query filter params (group.id=5dd933b06991445492c84396c65ce175, role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=a6e4f17634924aae91ae8465492529bc) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:43.261810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:43.263266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23bda1-6897-426e-9b21-bab37c80b367 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:43.270172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 232/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 5 20:41:43 2022] GET /identity/v3/role_assignments?group.id=5dd933b06991445492c84396c65ce175&scope.project.id=a6e4f17634924aae91ae8465492529bc&role.id=ce695803124649b4ad62ca6ec15c935e => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:45.994893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0173-d227-4fca-9400-e63c905774b8 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.995733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0173-d227-4fca-9400-e63c905774b8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.996148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0173-d227-4fca-9400-e63c905774b8 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.998098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 224/456] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:46.002773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbbddd-8824-486e-844b-6746fe6a9d26 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.004131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbbddd-8824-486e-844b-6746fe6a9d26 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.004554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbbddd-8824-486e-844b-6746fe6a9d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.025092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-51cbbddd-8824-486e-844b-6746fe6a9d26 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:46.026233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-51cbbddd-8824-486e-844b-6746fe6a9d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:46.129833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 233/457] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:46.171350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0173-d227-4fca-9400-e63c905774b8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.191551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b416-eb16-436a-be1b-2084af17d91a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.192218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b416-eb16-436a-be1b-2084af17d91a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.192761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b416-eb16-436a-be1b-2084af17d91a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.194629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 234/458] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:46.199880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96190836-0bae-4f70-8a79-ef825648c435 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.200413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96190836-0bae-4f70-8a79-ef825648c435 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.200984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96190836-0bae-4f70-8a79-ef825648c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.218612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-96190836-0bae-4f70-8a79-ef825648c435 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:46.220167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-96190836-0bae-4f70-8a79-ef825648c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:46.268956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:46.322269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 235/459] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:41:46.324018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f885a-a6bd-42ca-8b39-040bb0e50bd1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.324501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f885a-a6bd-42ca-8b39-040bb0e50bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.324991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f885a-a6bd-42ca-8b39-040bb0e50bd1 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.326721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 236/460] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:46.337654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0173-d227-4fca-9400-e63c905774b8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.338441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.338827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.339203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.340896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:46.370144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:46.371499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:46.380634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.381742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.382313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.382876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.400619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.402135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:46.421543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:46.422643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:46.423599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:46.423599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:46.423599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:46.423599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:46.424768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 225/461] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:46.425791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.467330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 237/462] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:46.468242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.556451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff23fa7-73bf-4094-9aea-7c9fb184e277 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.594468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:46.597466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.598269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.598555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.598829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.601195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60b32-7142-4dac-a7b9-b482d5cbdf51 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.609968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.611862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:46.631463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:46.632558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:46.633672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:46.633672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:46.633672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:46.633672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:46.633672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 226/463] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:46.633672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.645865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:46.646471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3980f-d651-4172-8762-46631318795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.647486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3980f-d651-4172-8762-46631318795c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.647832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3980f-d651-4172-8762-46631318795c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.648052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3980f-d651-4172-8762-46631318795c None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.649330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3980f-d651-4172-8762-46631318795c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:46.649641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3980f-d651-4172-8762-46631318795c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.651448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3980f-d651-4172-8762-46631318795c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:46.664520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 238/464] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:46.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353a10-e0ca-436b-ba56-e6c1c2e82e98 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.666779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353a10-e0ca-436b-ba56-e6c1c2e82e98 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.667458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353a10-e0ca-436b-ba56-e6c1c2e82e98 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.669803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 239/465] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:46.671102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae353a10-e0ca-436b-ba56-e6c1c2e82e98 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.744553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fa97-8f97-4225-accb-027f6a91944d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.780376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.781304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.781591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.781858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.787822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae353a10-e0ca-436b-ba56-e6c1c2e82e98 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.793567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.795168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:46.814633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:46.816264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:46.817440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:46.817440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:46.817440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:46.817440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:46.818955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 227/466] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:46.819868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.830897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.831615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.831903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.832219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.832910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:46.833257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.834645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6f67-9287-46f8-86ef-bc3d85e52811 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:46.846073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 240/467] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:46.847906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.848197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.848477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.865414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:46.866616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:46.881243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:46.894652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:46.938544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 241/468] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:46.946297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37daa1c4-96d9-42df-b313-171aaa98e7d6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.948776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.991892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.992913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.993225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.993810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.994800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.996522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.019765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 228/469] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:46 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:47.020602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.079307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe7536-f7a0-4aff-8e1c-67b3d28a4936 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.136352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.137649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.138144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.138604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.139529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:47.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.142527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.156444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f890eb-4080-446f-9997-3b6e982b8a8a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.164982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 242/470] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:47.164982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.178716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:47.183186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:47.213693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.213693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.213992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.214341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.214963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.216408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.244544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 229/471] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:47 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:47.245482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.305706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d47c6-2ea6-4efb-a248-e3791cd9016c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.358140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.359343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.360454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.361005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.378635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.385575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.386862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc573cfb-acb8-49ea-a4c4-26e32253438a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e4ec7d8c-d37f-4699-a1b5-744920476728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:47.408553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:47.410162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:47.411197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:47.411197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:47.411197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:47.411197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:47.414174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 243/472] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:47.416049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2374b-251f-419d-a9db-d56d39c1abad None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.420974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2374b-251f-419d-a9db-d56d39c1abad None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.421820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2374b-251f-419d-a9db-d56d39c1abad None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.424005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 244/473] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:47.425596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2374b-251f-419d-a9db-d56d39c1abad None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.427031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99e305-470d-49cb-8648-78e819259bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.427870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99e305-470d-49cb-8648-78e819259bd9 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.428203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99e305-470d-49cb-8648-78e819259bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.428525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99e305-470d-49cb-8648-78e819259bd9 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.429693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99e305-470d-49cb-8648-78e819259bd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.431600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99e305-470d-49cb-8648-78e819259bd9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.459857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 230/474] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:47 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:47.465414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.465414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.465414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.496386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:47.502361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:47.529332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:47.581966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:47.586039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2374b-251f-419d-a9db-d56d39c1abad None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.589381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 231/475] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:47.624435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.641943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.642867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.643154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.643433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.644731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:47.645268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.646685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.662920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 245/476] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:47.668523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.762711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3576b36-9723-4112-923f-10f1a2d03808 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.801401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942e4dc-65dc-4826-844d-b2fc792ff278 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:47.819001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.820289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.821114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.822188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.823257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.825225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.833617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:47.834502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.sql.core [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 20:41:47.834502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 20:41:47.834502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [parameters: {'id': 'c486553822c840c39f40a60dcd7a1f8f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 20:41:47.834502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80151) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result.read() Jul 05 20:41:47.855089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:41:47.856144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application yield resource Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise self.value Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application session.commit() Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 20:41:47.857120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.session.flush() Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application compat.raise_( Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 20:41:47.857994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:41:47.859994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result.read() Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:41:47.860839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [parameters: {'id': 'c486553822c840c39f40a60dcd7a1f8f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:47.863481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 20:41:47.866010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:47.869624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 232/477] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 5 20:41:47 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:47.876247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:47.895302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:47.895925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:47.896208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:47.896480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:47.897266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:47.898726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:47.906711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:47.956149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 246/478] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:47 2022] POST /identity/v3/users => generated 249 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:41:48.008630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241463d9-a70c-492f-87c2-fa6d7b8e06ce None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:48.048321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f2997-3603-4736-a3ce-a980f2d6074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:48.049578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f2997-3603-4736-a3ce-a980f2d6074d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:48.050769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f2997-3603-4736-a3ce-a980f2d6074d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:48.051264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f2997-3603-4736-a3ce-a980f2d6074d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:48.063756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f2997-3603-4736-a3ce-a980f2d6074d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f97f2997-3603-4736-a3ce-a980f2d6074d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:48.073669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:48.074598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:41:48.075401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:48.078075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 233/479] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:48.084422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:48.200481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5a14f-7db9-4809-83df-ee4079f722ae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:48.241360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:48.242448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:48.242946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:48.243444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:48.244404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:48.244905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:48.246563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0718-5ff5-46e6-93d7-9edcf22e363d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:48.257322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 247/480] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:49.375779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf677a93-4078-4d4e-9046-7b9eccb2af7b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:49.376785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf677a93-4078-4d4e-9046-7b9eccb2af7b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:49.377285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf677a93-4078-4d4e-9046-7b9eccb2af7b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:49.379993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 234/481] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:49.385728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:49.386515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:49.386987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:49.406370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:49.408571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:49.447557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:49.507200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 248/482] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:49.542628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf677a93-4078-4d4e-9046-7b9eccb2af7b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:49.634491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:49.658074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf677a93-4078-4d4e-9046-7b9eccb2af7b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:49.695711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:49.696887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:49.697396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:49.697862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:49.709920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:49.717948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:49.718931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:49.719850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:49.723268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 235/483] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:49.728909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:49.862112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e8efb-64fa-4264-84e0-47f83c5c5725 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:49.900436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:49.901480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:49.901958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:49.902437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:49.903372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:49.903882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:49.905515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:49.915561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 249/484] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:49.927084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.060824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05c426-4249-4a23-965e-36f9b101dc7a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.105890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.106688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.106971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.107245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.116514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:50.119403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:50.121131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3f6188dd-0b4c-4cf4-bd78-f0cb4ec31882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:50.140508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:50.141434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:50.142307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:50.142307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:50.142307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:50.142307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:50.142307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 236/485] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:50.147982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.199792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:50.247010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d86f-ada6-4794-bff4-7521d0e460ed None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.247215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d86f-ada6-4794-bff4-7521d0e460ed None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.247466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930d86f-ada6-4794-bff4-7521d0e460ed None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.250024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 237/486] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:50.257214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ece0a7-9d43-4d59-baaa-471f08f2f806 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.257495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ece0a7-9d43-4d59-baaa-471f08f2f806 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.257766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ece0a7-9d43-4d59-baaa-471f08f2f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.285502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-33ece0a7-9d43-4d59-baaa-471f08f2f806 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:50.289747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-33ece0a7-9d43-4d59-baaa-471f08f2f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:50.319541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d088056-9d0b-4e95-92a1-83622b6cec9a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.354637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.355305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.355584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.355859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.356580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:50.357063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:50.358270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196858e-529d-41fe-bebe-43010a55ef99 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:50.371496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 250/487] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:50.372896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571047-ecd6-41e5-9999-59aaaea0bada None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.373208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571047-ecd6-41e5-9999-59aaaea0bada None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.373481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571047-ecd6-41e5-9999-59aaaea0bada None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.380532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 251/488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:50.380532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571047-ecd6-41e5-9999-59aaaea0bada None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.382668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 238/489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:50.385285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.385775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.386514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.408425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:50.411148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:50.491443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 239/490] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:50.500957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.514736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:50.532454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571047-ecd6-41e5-9999-59aaaea0bada None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.563117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:50.569937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.570558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.570836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.571110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.578665 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:50.580111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:50.596390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:50.598136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:50.599055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 252/491] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:50.599636 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.623843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d73e4-98a8-40b8-9673-3b9272ca8d03 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.662737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.664328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.664803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.665283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.677615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:50.685914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:50.686810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:50.687644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:50.691031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 240/492] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:50.692716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.714284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca2167-ac7a-4dfe-a280-ed36d6a51a4c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.750925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.751638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.752019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.752207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.764859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:50.773189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:50.774113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:50.774931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:50.779309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 253/493] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:50.780189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.794286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:50.817884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d261cc3-7f33-493c-a55b-23f62923b770 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.836098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:50.858882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.859553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.859830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.860100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.860966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:50.861261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:50.862791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:50.890070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1cc7e-5223-459d-9149-8c9efa588fd1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:50.899941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 241/494] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:50.900765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:50.927779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:50.928457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.928745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.929050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.929800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:50.930110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:50.931495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae5e3-7737-4b67-b7f8-b08086d7509f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:50.939379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 254/495] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:50.940790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdffa9-441a-4867-a262-0c91a1423b35 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.941161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdffa9-441a-4867-a262-0c91a1423b35 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.941447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdffa9-441a-4867-a262-0c91a1423b35 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.942686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 255/496] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:50.943855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570531dc-417e-4607-ab69-486889bdd617 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:50.944061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570531dc-417e-4607-ab69-486889bdd617 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:50.944336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570531dc-417e-4607-ab69-486889bdd617 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:50.945695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 256/497] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:50.946260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570531dc-417e-4607-ab69-486889bdd617 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.004036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882d503-7596-46e8-b89b-6b97035a0d96 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.018020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.037972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.038888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.039170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.039445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.040180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:51.040485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.041884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.049563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570531dc-417e-4607-ab69-486889bdd617 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.050047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 242/498] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:51.050822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.080591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.086930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56953ebb-51cd-4394-af70-1082e4fa2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.087576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56953ebb-51cd-4394-af70-1082e4fa2810 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.087863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56953ebb-51cd-4394-af70-1082e4fa2810 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.088144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56953ebb-51cd-4394-af70-1082e4fa2810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.150206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f1bfc-0f88-4cf4-b1cb-2fb0fc870e6c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.156750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56953ebb-51cd-4394-af70-1082e4fa2810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.158253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56953ebb-51cd-4394-af70-1082e4fa2810 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.183488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.184274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.184560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.184837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.197327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.198777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-0c982800-fb88-46da-a35f-4fab6746937d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:51.216133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:51.217153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:51.218052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:51.218052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:51.218052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.218052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:51.218052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 243/499] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:51.218517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.218800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.219073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.230923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.235705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:51.236968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:51.263568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 257/500] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:51.264767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.265084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.265362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.280943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:51.282164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:51.311695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 244/501] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:51.312541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.337783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.349938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 258/502] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:51.350781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.425381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffe215-ca62-4b3e-9086-a7dc491d4657 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.452146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ab78f-3df4-48db-952e-5f0c84dd54d8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.453670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.461424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.462218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.462502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.462777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.472854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.474360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.486848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.487611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.487981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.488260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.489004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:51.489315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.490691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:51.491678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:51.492506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:51.498265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:51.498265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:51.498265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.498265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:51.498265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 245/503] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:51.498265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.502679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 259/504] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:51.504097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.562848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.598679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58807a-e46c-4f05-8231-66b5c088cf84 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.610185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48bb4-bd70-4815-95c7-25afc9c30a72 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.631930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.632716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.633027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.633298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.643663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.643947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.644557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.644844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.645148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.645250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.656201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.657676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:51.663126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:51.664380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:51.665305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:51.665305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:51.665305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.665305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:51.665305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 246/505] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:51.665585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:51.680897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:51.681804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:51.682694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:51.682694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:51.682694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:51.682694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:51.682694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 260/506] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:51.682988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.698796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.772555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a211e13-3f66-4ca3-9856-e5dd4ba71612 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.791001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.793284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953594d-7b6e-48fc-aafe-d405e2a0ff00 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.807886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.808674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.808986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.809264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.819413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:51.827023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:51.828106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 247/507] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:51.829228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.829980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.830426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.830719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.831503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.832220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:51.832520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.833985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.846076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 261/508] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:51.846934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:51.923397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:51.931062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872103a4-f3f3-4a25-997a-60e0754b7d99 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.950065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20fd5d-42a1-4f0c-9c53-25573182efa2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:51.964717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.965540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.965824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.966097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.973991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.975444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.984671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:51.985348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:51.985632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:51.985906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:51.986614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:51.986914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:51.989646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:51.995817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:51.996713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 248/509] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:51.998185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.004985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 262/510] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:52.005898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.039125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.098402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030189e-9735-41b1-8b52-a55cabf0bd67 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.104760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff304d-4f92-482a-80c8-45a4ecf588d6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.131491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.132144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.132427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.132702 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.133439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:52.133743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.135118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.138339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.139000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.139284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.139562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.140305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:52.140609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.142014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.143364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.146655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 249/511] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:52.148279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.154451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 263/512] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:52.155359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.245607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.250441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2700-209c-41af-849d-31abd859cbe7 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.256783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a5ee-99e3-4f03-8a48-02b3f20536f1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.282789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.283585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.283868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.284683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.290336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.290998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.291277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.291550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.292380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:52.292681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.292781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.294157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.294247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:52.308993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:52.310107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 250/513] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:52.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.332858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 264/514] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:52.333704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.388672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.415069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a739-8ed2-4da9-8414-650672a04360 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.434265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bff820-9d60-452b-aa9e-29024dc22181 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.448076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.448862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.449169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.449438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.455947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.457981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.468343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.469028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.469313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.469586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.470285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.471765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:41:52.472331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:52.473355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:52.474266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 251/515] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:52.474738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.493235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.494042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 265/516] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:41:52 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:41:52.494919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.592979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adafc1-8ba9-4009-a2cb-126bf577afa5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.613970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74d2a-4b2a-41ad-ad9d-000cb24ba004 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.625691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.636142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.636972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.637259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.637532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.650500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.651200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.656794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.657504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.657790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.658064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.658901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:52.659765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.661881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:52.670040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:52.670888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:52.671773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:52.671773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:52.671773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:52.671773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:52.671773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 252/517] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:52.672440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.684877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 266/518] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:52.686910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.758689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.798305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84623-2bce-40cc-9971-6ec2b268252a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.808248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c5f2-1fc5-4fe7-8591-b90097fb669b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.838037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.838970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.839252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.844493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:52.845179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:52.845462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:52.845736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:52.847093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:52.847400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.849038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.867878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 267/519] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:52.868703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:52.900047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:52.917663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:52.919154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:52.979548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306add1-631f-4e31-b0b4-6485712652db None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:52.990400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.015344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.016009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.016293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.016566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.017314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:53.017619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.019050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.028553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 253/520] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:53.028553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.035109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 268/521] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:53.036973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.130920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.138605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9d60b-0a91-45a2-91ad-4d9ddfe24d67 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.143055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaab9c-74e5-4018-a61a-59ad643d8e53 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.177245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.177564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.177820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.178097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.178195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.178364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.178558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.178753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.179574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=624366e88245426a8837e3ce0b714531) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:53.179882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.181355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.187039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 269/522] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/role_assignments?user.id=624366e88245426a8837e3ce0b714531&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:53.197992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.237036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.276669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.278675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.333516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb1a43-302f-4054-8f7c-60535cc5cf8b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.375989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.376783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.377099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.377377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.388398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.389976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.404877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 254/523] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:53.405991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:53.414075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:53.414960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:53.415811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:53.415811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:53.415811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:53.415811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:53.415811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 270/524] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:53.416707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.441376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.493087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.535922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6bac3-3c58-4d1a-8f33-82915b4b4607 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.546659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdba2b-e3d2-4bd1-b576-e2acc8b22c02 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.578508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.579311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.579595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.579868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.587917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.589400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.590028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.590891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.591425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.591815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:53.606087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:53.607042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:41:53.607943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:53.608464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.608464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.611940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 255/525] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:53.613406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:53.637766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:53.639121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:53.639972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:53.639972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:53.639972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:53.639972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:53.643182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 271/526] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:53.645330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.725577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.735840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d063c-4210-4463-b268-6c49e1c972b3 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.780668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:53.780945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d5d78-3dfd-4e56-877a-995fe1d1e770 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.789324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.790145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.790533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.790908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.791998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:53.792112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.793756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.807193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 256/527] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:53.808112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.836021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.837187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.837630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.838447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.840121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:53.841086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.844112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.869090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 272/528] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:53.870197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:53.924484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a54b7-0e1b-476a-95f4-e90a3179486e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:53.961442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:53.962261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:53.962976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:53.962976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:53.963798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:53.964245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:53.965732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:53.979743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 257/529] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:53.980642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.007326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd762fa-bb08-43e5-8170-6c729a0f7e23 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.027367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.040013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.057447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.058744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.059763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.060180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.069222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.071694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:41:54.092621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:54.093649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:54.094709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:54.097188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3356c-7795-4342-8d1c-a52c488cacff None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.097832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 273/530] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:54.098822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.146576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.147816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.148490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.148909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.208845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3262-2459-4bac-b27e-fdb735e89f7b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.240592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.242579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.245039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.246254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.246254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.246466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.253950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.255413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:41:54.270152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:54.271226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:54.272149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:54.276107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 274/531] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:54.276956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.303353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.325243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.369803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 258/532] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:54.370979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.416855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14ba8-0e16-420d-98ea-e4a9a415909f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.464803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.465767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.466204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.466727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.467763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:54.468215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.469819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.483721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 275/533] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:54.484904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.488619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8df15-9ffa-446e-8b2d-3582e592ca3a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.532619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.533259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.533511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.533788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.534858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:54.535278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.536859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.556088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 259/534] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:54.561627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.575227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.587639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.594823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce990-bee6-41e8-91c7-e61e9838bcc2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.631150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.631939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.632220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.632492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.643090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.645281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:54.665397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:54.666286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:54.667155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:54.667155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:54.667155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:54.667155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:54.667155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 276/535] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:54.667903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.674857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaffbe-f860-4026-b8f2-d17a7f6b5bad None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.709810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.710467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.710749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.711026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.711851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=04a4d556adeb43139a65f61af0076091) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:54.712168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.713642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331ff9-c7ad-4f23-a8fa-869a9ab150ae None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.719191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 260/536] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/role_assignments?user.id=04a4d556adeb43139a65f61af0076091&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:54.726527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1144b-ed44-4d7e-9b82-cc5b15b77247 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.726852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1144b-ed44-4d7e-9b82-cc5b15b77247 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.727072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1144b-ed44-4d7e-9b82-cc5b15b77247 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.733794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 261/537] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:54.733794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1144b-ed44-4d7e-9b82-cc5b15b77247 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:54.823441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453b256-7a2b-432e-8ec9-1c0efe412212 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.835608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.867911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1144b-ed44-4d7e-9b82-cc5b15b77247 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:54.879308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.880408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.880695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.880978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.883128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=dbd8ecdcc21f4d22b969036c1d7a3672) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:54.883128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.884527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51be65-6c37-4f40-a253-a58992a263f0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.891561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 277/538] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/role_assignments?user.id=dbd8ecdcc21f4d22b969036c1d7a3672&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:54.894032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.894330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.894608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.930994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:54.932208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:54.936185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:54.936872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:54.937462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:54.937737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:54.938647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:54.938956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:54.940473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:54.945444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:54.967830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 262/539] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:54.974324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.102341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 278/540] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:55.118946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7d52b-ab3c-468f-82a1-6056cf762afa None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.158015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.166027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:55.166826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.167101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.167397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.182993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:55.185880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:55.187590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:41:55.215961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:55.216886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:55.217834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 263/541] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:55.224300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.361161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19871d-d7dd-4aa8-a2c3-2d43a46ba415 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.394414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c29377-ed52-4275-986b-0dcfe7ae27f1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.400842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:55.401738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.402647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.403022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.404731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:55.405234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:55.407623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773e617-6b69-44af-9aab-5cf38bcd733d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:55.425684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 264/542] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:55.427178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5ebd-c4bd-4280-a9d9-28dd64236a05 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.427465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5ebd-c4bd-4280-a9d9-28dd64236a05 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.427734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5ebd-c4bd-4280-a9d9-28dd64236a05 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.429238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 265/543] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:55.430937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff5ebd-c4bd-4280-a9d9-28dd64236a05 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.436335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9905819-8c08-4d1c-a50c-4fd7cbde74eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:55.437161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9905819-8c08-4d1c-a50c-4fd7cbde74eb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.437445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9905819-8c08-4d1c-a50c-4fd7cbde74eb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.437719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9905819-8c08-4d1c-a50c-4fd7cbde74eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.450621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:55.457488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9905819-8c08-4d1c-a50c-4fd7cbde74eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e9905819-8c08-4d1c-a50c-4fd7cbde74eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:55.469356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:55.470281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:55.471082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:55.473654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 279/544] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:55.475024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.475446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.475845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.501081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:55.503563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:55.504723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:55.553558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff5ebd-c4bd-4280-a9d9-28dd64236a05 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.594377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:55.595237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 280/545] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:55.595418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.595856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.596268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.596732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.597703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=39aef7668f15405b8d665fe61e6a49c4) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:55.598153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:55.600094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:55.607729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 266/546] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/role_assignments?user.id=39aef7668f15405b8d665fe61e6a49c4&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:55.622703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.750176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eace05-a8d9-4ac6-9285-b9f036c4cc91 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.760111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a43920-50b8-4656-a666-f2c58ebca80d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.775988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:55.799885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:55.803794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:55.805174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.805636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.806101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.807288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:55.808037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:55.808409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:55.808756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:55.809602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:55.809972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:55.811535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:55.821240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:55.825818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 281/547] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:55.827190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:55.830287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:55.831364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:55.832176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:55.835397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 267/548] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:55.845364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:55.981621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9d41-f828-40fd-914d-546683beeb68 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:55.991444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb292-4ab5-4d84-af87-e38b322cfc8a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.026226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.027256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.027952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.028434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.029406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:56.030216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.031780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.043015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 268/549] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:56.051745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.069117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.069979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.070257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.070565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.088479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.089977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:56.124662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:56.126159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:56.127189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:56.127189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:56.127189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:56.127189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:56.130674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 282/550] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:56.132001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.146148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:56.195248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:56.260307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f588f0-0490-442a-9b01-3268b4c76e62 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.276665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb1a72-f12c-4d49-b740-7f1e3a4a4b95 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.319766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.320706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.321029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.321306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.332173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.333720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:56.351125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:56.352027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:56.353024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:56.353024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:56.353024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:56.353024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:56.356901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 269/551] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:56.358076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.361654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.362878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.363176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.363568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.364317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:56.364630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.366067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.392112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 283/552] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:56.393817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.528409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:56.546793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb524e0-9c14-40c1-a15c-a740d7c7acbb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.594988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a77fe-8299-46f3-a68c-d5a603c2e19d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.601463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:56.621612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.622281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.624053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.624336 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.625084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:56.625388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.629404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.652475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 270/553] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:56.658098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.666403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.667211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.667488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.667760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.679879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.681442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:56.708423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:56.709516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:41:56.710493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:56.715901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 284/554] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:41:56.718058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.863925 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727696e7-d664-4ea2-ac76-f1b1bbfb215f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.910586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d677de-ba5b-40f6-be65-e13a387115c7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:56.930622 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.931816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:56.932101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:56.932371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:56.941618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:56.943692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:56.959562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:56.960545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:41:56.962049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:56.965410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 271/555] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:56.967101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:56.985774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:56.999218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:56.999899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.000183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.000457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.002593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:57.004270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.006412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d40bd4-7f8b-4ad0-8171-145f5d075d6e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.028763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 285/556] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:57.030145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43bdf-3d32-4150-b775-4ac26779a633 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.030432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43bdf-3d32-4150-b775-4ac26779a633 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.030708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f43bdf-3d32-4150-b775-4ac26779a633 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.036803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 286/557] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:57.037650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43bdf-3d32-4150-b775-4ac26779a633 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.063546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.099633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963323-3067-4cf4-8548-2a3185a9575c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.138808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.139396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.139677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.139950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.140778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:57.141118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.142572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a896d5-d7c5-4cda-be06-b3bef7aec673 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.147577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f43bdf-3d32-4150-b775-4ac26779a633 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.161000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 272/558] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:41:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:41:57.162354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d60689-435e-4628-b5f9-f3430faff326 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.162643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d60689-435e-4628-b5f9-f3430faff326 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.162915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d60689-435e-4628-b5f9-f3430faff326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.181443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e5d60689-435e-4628-b5f9-f3430faff326 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:57.182634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e5d60689-435e-4628-b5f9-f3430faff326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:57.193204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fcd23-e67a-404c-ac73-27a99a5dae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.193856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fcd23-e67a-404c-ac73-27a99a5dae0d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.194303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fcd23-e67a-404c-ac73-27a99a5dae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.194412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fcd23-e67a-404c-ac73-27a99a5dae0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.248082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.253653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 273/559] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:57.254928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a2f25-98b9-4276-acd8-df578f3beea8 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.255209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a2f25-98b9-4276-acd8-df578f3beea8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.255484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a2f25-98b9-4276-acd8-df578f3beea8 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.264979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 274/560] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:57.264979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a2f25-98b9-4276-acd8-df578f3beea8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.271845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fcd23-e67a-404c-ac73-27a99a5dae0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.273422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fcd23-e67a-404c-ac73-27a99a5dae0d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.298142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.368629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a2f25-98b9-4276-acd8-df578f3beea8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.390018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 287/561] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:41:57.391292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.391581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.391853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.404601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.405446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.405729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.406002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.408084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:57.410070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:57.417394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.418853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:57.436715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:57.437660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:57.438645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:57.438645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:57.438645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:57.438645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:57.438645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 275/562] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:57.438924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.495330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 288/563] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:57.496169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.506078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.555196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.564677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a5266-c14d-44ca-a962-3ebcd6229512 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.602369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.603299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.603584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.603852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.607794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d10a9-8ff6-430f-996a-25ee172164ef None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.615011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:57.622740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:57.624131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 276/564] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:57.625019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.650147 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.650867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.651148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.651422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.662632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.664440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:57.682824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:57.683775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:57.684679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:57.684679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:57.684679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:57.684679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:57.684679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 289/565] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:57.685567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.750614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da49b-b9fb-4234-9fe1-982d40e93eaf None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.766877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.791333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.791995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.792275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.792744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.793286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:57.793585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.794939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.802010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839bfd3-8bda-4765-94f9-63a567efccf8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.804824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:57.813341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 277/566] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:57.813341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.838566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.839371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.839657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.839932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.851311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:57.859106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:57.860076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 290/567] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:57.861709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:57.933383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed1bc0-4cb2-4262-9e4c-91756e193a62 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.970334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:57.971003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:57.971309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:57.972611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:57.972721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eabf6-ab6c-4298-be1c-5f96b65b601d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:57.973180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:57.973358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:57.974974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:57.983727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 278/568] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:57.984647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.013054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.013712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.013990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.014261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.014975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:58.015277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.016672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.027251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.031556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 291/569] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:58.032441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.061072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.101140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14d9f9-86fa-4f12-9c4e-d1b35b904ee8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.137182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.137972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.138254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.138527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.146198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.146354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8d395-0f18-4818-b198-b1ae06024e98 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.147725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:41:58.162110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:58.163049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 279/570] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:58.164520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.182474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.183224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.183563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.183791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.184537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:58.184846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.186280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.198981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 292/571] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:58.198981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.258806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.265561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5f1e7-4d4f-4831-b8eb-2a55fce92ecb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.280922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.296538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d196f9-ba10-46a2-a6d8-872df3ef8c88 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.300185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.300999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.301286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.301559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.311637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.313134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-7fcbb7aa-8df6-4652-9e8f-4509a7bb02e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:58.331638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:58.332567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:58.333528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:58.333528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:58.333528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:58.333528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:58.333752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543af5-06f3-4893-9232-d423299094af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.333752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543af5-06f3-4893-9232-d423299094af None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.333752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543af5-06f3-4893-9232-d423299094af None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.333959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 280/572] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:58.334036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543af5-06f3-4893-9232-d423299094af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.334150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5fc86-0af3-49f6-92c7-c74c80eee31a None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.334424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5fc86-0af3-49f6-92c7-c74c80eee31a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.334701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5fc86-0af3-49f6-92c7-c74c80eee31a None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.335943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 281/573] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:41:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:58.336613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5fc86-0af3-49f6-92c7-c74c80eee31a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.342254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543af5-06f3-4893-9232-d423299094af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.343718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543af5-06f3-4893-9232-d423299094af None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-58543af5-06f3-4893-9232-d423299094af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:41:58.358345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:58.359249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 293/574] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:58.360720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543af5-06f3-4893-9232-d423299094af None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.444030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5fc86-0af3-49f6-92c7-c74c80eee31a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.464063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543af5-06f3-4893-9232-d423299094af None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.477535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.478193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.478479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.478756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.479535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:58.479841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.481319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.493241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 282/575] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:58.493856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.499595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.500383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.500663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.500952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.503580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.512812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.514294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.521619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-56d00503-f526-4b27-b11f-5601ceb96593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:58.533276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:58.534968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:58.535873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:58.535873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:58.535873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:58.535873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:58.535873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 294/576] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:58.536417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.536590 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.536915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.553702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:58.554873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:58.596477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d72f2e-e211-405e-a3a0-972fd41a58a9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.619610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 295/577] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:41:58.620474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.630158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.630822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.631102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.631377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.632088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:58.632388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.633834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.645757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 283/578] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:58.646530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.710648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.721728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8764a4-e74e-4960-ac6e-2617ea2f0392 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.744520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0af9d-70e5-4cbd-9b1d-7f9a61b19b5c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.748156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.756961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.757637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.757919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.758196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.758975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:58.759282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.760785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.778557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 296/579] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:58.779570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.779782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.780658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.780969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.781241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/624366e88245426a8837e3ce0b714531/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.797276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=624366e88245426a8837e3ce0b714531, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.798843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.811352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 284/580] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:41:58 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/624366e88245426a8837e3ce0b714531/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:41:58.812300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.905037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aec86-418e-45b0-9a3a-f0e0e88a4b8e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.927948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a7657-e39f-4d12-92ec-ae874ac71b96 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:58.945811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.946231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:58.947785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.948138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.948448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.949348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:58.949662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:58.952020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:58.969664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 297/581] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:58.969832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:58.970436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:58.970541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:58.970729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:58.971000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:58.985092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:41:58.993181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:58.994127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:41:58.995409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 285/582] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:58.996447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.030480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.082746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39413376-1aef-4d5a-b095-c2f12bdd4e74 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.105709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8d13-12f9-4052-b525-fab16f139263 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.118213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.119021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.119307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.119585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.126874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.129342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.141977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.142633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.142912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.143271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.144212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=56392bbbf8e449cfbcdddd6a492444bb) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:59.144522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:59.144855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:59.145805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:41:59.146786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:59.147331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.150712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 298/583] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:59.151541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.151997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 286/584] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:41:58 2022] GET /identity/v3/role_assignments?user.id=56392bbbf8e449cfbcdddd6a492444bb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:59.152767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.214269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.293921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206173-6812-45d3-bd65-8c2bb32b47d8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.300151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c4ee-9ab2-42a5-bafa-5322f357c02a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.308286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.344779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.345420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.346162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.346358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.346675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.347021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.347312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.347764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.348102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:59.348470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.349931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.356666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.358363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.364699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 287/585] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:59.364699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:41:59.379172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:59.380174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:59.381171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 299/586] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:59.381779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.491473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce51af-72bc-4802-9cda-a95334f83427 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.503614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88597-7ec9-41c6-ba29-5d90c8b39e84 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.505320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.539133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.539946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.540227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.540797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.542110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:59.542668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.544550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.546300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.547298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.548380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.548722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.562111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.564511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.567416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 288/587] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:59.568335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:59.591015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:59.592131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:59.593071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:59.593071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:59.593071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:59.593071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:59.597074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 300/588] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:59.597765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.631398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.683743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653a8b-2651-491a-9159-91d7eab84846 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.728904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef4e46-5a21-4671-bf1a-4d5790844543 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.732367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.733069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.733351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.733626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.734452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:59.734843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.737173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.761376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 289/589] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:59.762222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.771291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.772521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.773028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.776308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.787789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.789888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.792198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:41:59.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:41:59.813228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:41:59.814150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:41:59.814150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:41:59.814150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:41:59.814150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:41:59.817314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 301/590] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:41:59.818408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:59.892609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c168f-403e-4f30-8a5d-361c4dc5c771 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.920043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:59.940573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:59.941519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:59.941807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:59.942084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:59.943214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:41:59.943523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:59.944976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:59.961714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb870-3906-4da7-93d8-db8683da1874 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:59.965095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 290/591] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:41:59.965955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.008839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.010351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.010641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.011176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.025920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.027901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:00.051404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:00.052783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:00.053747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:00.053747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:00.053747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:00.053747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:00.053747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 302/592] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:00.054379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.074567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.106043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f797ff-2265-4eb2-8d09-5467c089d808 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.149938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.151077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.151463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.152704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.153582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:00.153994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.155483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.171891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 291/593] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:00.172859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.194182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eec8c7-fd7a-4c42-b642-f2d76c51b91f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.228581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.241276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.241799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.242089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.242372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.250274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.251706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:00.267254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:00.269191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 303/594] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:00.270401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.300503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb05d4-bfe2-4975-afc7-850b011b1906 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.338678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.339586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.340011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.340426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.341340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:00.341806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.343310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.351035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.357912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 292/595] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:00.358906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.381419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43c4b6-c68f-4747-ac39-1141eb070f4d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.418742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.419542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.419827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.420108 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.428420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.429909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:00.445245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:00.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:00.447407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 304/596] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:00.451871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.477550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f8dfa-32a5-43f1-aeb7-d807b372585e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.502188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.516732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.517699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.518795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.519246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.520214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:00.520662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.522264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.541498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 293/597] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:00.542626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.565417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c8dbf-054a-4b3d-83b8-07f839d2e40f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.602043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.602391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.603381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.603492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.603785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.613010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.614497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:00.630330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:00.631252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:00.632141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 305/598] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:00.633102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.655200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75643e-5036-4d79-a94f-139c72ee9e12 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.692651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.694155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.694676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.695142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.696140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:00.696662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.698392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.711636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 294/599] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:00.712715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.749573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c95e9-e805-4c9e-9ce1-3dbc6bc24d43 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.752077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.798718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.799553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.799837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.800112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.812285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.813895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.825534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a62cd-d1ba-43ca-8ef2-cc2e9a297cac None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:00.832602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:00.833516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:00.834425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:00.834425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:00.834425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:00.834425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:00.834425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 306/600] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:00.835106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.861477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:00.865913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.866818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.867294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.867818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.869250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:00.869775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:00.871466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:00.888187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 295/601] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:00.889629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:00.948639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9900-503d-455a-a16e-8c32ed737411 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:00.987984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:00.988877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:00.989186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:00.989466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/04a4d556adeb43139a65f61af0076091/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:00.999946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8d7d9-5a93-4b75-8dfa-ce404b5bd3d9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.006477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=04a4d556adeb43139a65f61af0076091, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.008118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.032963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 307/602] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:00 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/04a4d556adeb43139a65f61af0076091/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:01.032963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.041954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:01.052010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.053371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.053837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.054276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.055234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:01.055885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.057660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da97d02-3a49-42ef-9296-29bfb5470464 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.076968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 296/603] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:01.076968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00aeba-c52c-4b39-a608-648a05dc9556 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.076968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00aeba-c52c-4b39-a608-648a05dc9556 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.076968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00aeba-c52c-4b39-a608-648a05dc9556 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.076968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 297/604] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:01.081209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00aeba-c52c-4b39-a608-648a05dc9556 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.136050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:01.169022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd2991-ce4c-4a5d-8f77-a0944c60fb75 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.211299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf9354-c915-44c1-86c3-d22b5fa21693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.212201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf9354-c915-44c1-86c3-d22b5fa21693 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.212480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf9354-c915-44c1-86c3-d22b5fa21693 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.212752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf9354-c915-44c1-86c3-d22b5fa21693 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/dbd8ecdcc21f4d22b969036c1d7a3672/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.231995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf9354-c915-44c1-86c3-d22b5fa21693 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=dbd8ecdcc21f4d22b969036c1d7a3672, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.233496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf9354-c915-44c1-86c3-d22b5fa21693 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.234540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00aeba-c52c-4b39-a608-648a05dc9556 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.250358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 308/605] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:01 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/dbd8ecdcc21f4d22b969036c1d7a3672/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:01.254114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa3b76-a221-480b-9ce6-fa82161a1fe8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.254114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa3b76-a221-480b-9ce6-fa82161a1fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.254114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa3b76-a221-480b-9ce6-fa82161a1fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.280593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dbaa3b76-a221-480b-9ce6-fa82161a1fe8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:01.281843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dbaa3b76-a221-480b-9ce6-fa82161a1fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:01.300711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.301687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.301969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.302240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.313888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.316154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-5e501390-4ce3-47fa-80f9-fa5b4bcb7169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:01.334271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:01.335263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:01.336235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 298/606] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:01.337152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ef49-8295-42a2-8ce5-218346759287 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.337438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ef49-8295-42a2-8ce5-218346759287 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.337714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ef49-8295-42a2-8ce5-218346759287 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.339231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 299/607] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:01.344141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ef49-8295-42a2-8ce5-218346759287 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.374519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:01.413129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 309/608] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:01.414899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.415197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.415478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.439489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:01.441409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:01.479539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:01.486651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ef49-8295-42a2-8ce5-218346759287 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.518687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 310/609] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:01.519650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.530783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.531585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.531920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.532199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.533068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:01.533377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.536578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.550842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 300/610] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:01.555019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.667350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce583bd-e1d4-4228-ac3a-857279d27beb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.681751 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1ad2-1355-485c-a18f-1819b4070cad None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.690402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:01.716756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.717828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.718202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.718483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.718611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.719330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.719616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.719890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.731255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:01.731534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:01.740023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:01.742223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:01.744222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:01.745749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:01.747739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:01.754249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:01.754926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 311/611] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:01.754926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.755061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 301/612] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:01.755061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.776250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:01.866444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4ffc-73d8-4f7b-9449-59fa58d9e8f6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.888042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2403-b29d-41e1-b2a6-443b210baa3f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:01.904213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.905409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.905978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.906456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/39aef7668f15405b8d665fe61e6a49c4/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.923287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=39aef7668f15405b8d665fe61e6a49c4, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.925160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.931790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:01.932526 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:01.933092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:01.933380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:01.934277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:01.934592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:01.936585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:01.941762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 312/613] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:01 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/39aef7668f15405b8d665fe61e6a49c4/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:01.942829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.959864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 302/614] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:01.965351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:01.990365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:02.081975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b18c9-f706-4e2e-abb2-b100d7dd91df None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.105432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:02.147329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.149768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.150116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.150382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d6842-c2ab-4435-9d61-1e10b654ea9d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.150490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.151313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:02.151695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.153339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.172838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 313/615] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:02.187615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:02.203845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.207251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.207251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.207251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.225949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.227750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:02.250523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:02.251556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:02.252579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:02.252579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:02.252579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:02.252579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:02.254725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 303/616] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:02.263279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:02.352655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:02.378513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca63b7-e280-44f5-b6b1-776e1b134b17 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.410768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a30b-0ebd-446b-b17f-6f54d41ced61 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.441073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:02.449440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49972040-fe12-4980-a736-d49084079250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.450112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972040-fe12-4980-a736-d49084079250 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.450396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972040-fe12-4980-a736-d49084079250 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.450671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49972040-fe12-4980-a736-d49084079250 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.451393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49972040-fe12-4980-a736-d49084079250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:02.451697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49972040-fe12-4980-a736-d49084079250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.452504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.453327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.453587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.454401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.454506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49972040-fe12-4980-a736-d49084079250 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.475607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 304/617] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:02.478113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.479577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.480869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49972040-fe12-4980-a736-d49084079250 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:02.510301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:02.511269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:02.512184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:02.512184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:02.512184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:02.512184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:02.512184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 314/618] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:02.521974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:02.608022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49972040-fe12-4980-a736-d49084079250 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.647959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.648761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.649074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.649343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.658052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.660182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:02.676657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:02.677696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:02.678806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 305/619] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:02.683299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:02.749437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:02.791437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1215111-8cdd-43b7-b31f-0a38b2e876ef None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.848707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.849462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.849747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.850022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.850858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:02.851162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.852615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.860203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f631a56-a75a-41a7-a30c-6b92d4b5fa18 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:02.898274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:02.898946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:02.899277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:02.899552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:02.900272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:02.900571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:02.902093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:02.906158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 306/620] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:02.916029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 315/621] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:02.916833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:02.917291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:02.921562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.121223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bf4ec-f729-4f3c-b649-24407cb11c09 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.142843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421b9cf-d3fb-4a67-a6e1-e274f0db3a28 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.159652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.160609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.160894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.161203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.167182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:03.169855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.171611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:03.188402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:03.189871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:03.190861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:03.194532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 316/622] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:03.195886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.290210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:03.297627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d490fb7-05df-47ff-b5c9-269c2078a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.298297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d490fb7-05df-47ff-b5c9-269c2078a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.298576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d490fb7-05df-47ff-b5c9-269c2078a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.298843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d490fb7-05df-47ff-b5c9-269c2078a9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.303021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd45d81-39d4-4125-96da-2c2932a8b4c0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.341992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.343269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.343785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.344307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.345579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:03.346917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.348919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2b4d-9629-449d-94fc-bda49616a510 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.370804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 317/623] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:03.372336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c420c-115b-4280-8846-819cf9f19617 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.372572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c420c-115b-4280-8846-819cf9f19617 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.373010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c420c-115b-4280-8846-819cf9f19617 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.379005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 318/624] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:03.379005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c420c-115b-4280-8846-819cf9f19617 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.384381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d490fb7-05df-47ff-b5c9-269c2078a9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.385536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d490fb7-05df-47ff-b5c9-269c2078a9d7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.490125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 307/625] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:42:03.491423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.491711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.491981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.495551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c420c-115b-4280-8846-819cf9f19617 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.513683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:03.514995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:03.516517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:03.517008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:03.544578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.545541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.545826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.546232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.558958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.560469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:03.582105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:03.583110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:03.584087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:03.584087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:03.584087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:03.584087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:03.584087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 319/626] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:03.584819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.592061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 308/627] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:03.592904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.696554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1942fb-9bc4-4803-86d1-8fbb197ea3c5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.698247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d2fc-b163-4c6d-ac05-20be44a88b3e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.734788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.735815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.736202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.736498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.741284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.741954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.742234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.742505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.743221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:03.743520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.744889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84328ae1-6ba6-4aba-a885-09de9249ad7a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.748873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.750349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.752082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:03.762930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 309/628] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:03.764005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564001cc-d337-4d28-b395-caf2331321b8 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.764292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564001cc-d337-4d28-b395-caf2331321b8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.764567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564001cc-d337-4d28-b395-caf2331321b8 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.770619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 310/629] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:03.770619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564001cc-d337-4d28-b395-caf2331321b8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:03.776845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:03.777795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:03.778702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:03.778702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:03.778702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:03.778702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:03.778702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 320/630] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:03.778702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.804485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:03.886921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86387-0ba9-41e6-982c-12036ef04dd3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.895821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564001cc-d337-4d28-b395-caf2331321b8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:03.925177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.926294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.926852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.927128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.933184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5d91b-8272-450a-b6b4-4f333de4f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:03.933982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d91b-8272-450a-b6b4-4f333de4f527 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.934265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d91b-8272-450a-b6b4-4f333de4f527 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.934541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5d91b-8272-450a-b6b4-4f333de4f527 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.935516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:03.937587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:03.945775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5d91b-8272-450a-b6b4-4f333de4f527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:03.953662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:03.954748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:03.956472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3fb5d91b-8272-450a-b6b4-4f333de4f527 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:03.957138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:03.958198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:03.959233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 311/631] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:03.961520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:03.966199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:03.966199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:03.966847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 321/632] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:03.968746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:03.979761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:03.981357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:04.038554 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.060962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 312/633] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:04.060962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.069746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.092643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac77d2-7161-494d-9a33-067790e6dffa None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.129452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.130121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.130528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.130805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.131520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:04.131826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.133218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.146069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 322/634] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:04.146739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.174264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65737b0-b1d2-4b28-af78-03ec19f7967c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.209051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.209663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.209948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.210227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.210980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:04.211286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.212664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.222110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 313/635] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:04.223786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.273285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e5183-bab4-4928-9581-3de2061789ab None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.282159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.308868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.309558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.309843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.310121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.310906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:04.311212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.312657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.324815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 323/636] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:04.325744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.328181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.335408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaba0-be0f-4741-9653-5704151f9bea None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.369144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.370234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.370521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.370946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.380839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:04.388329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:04.389533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:04.390405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 314/637] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:04.391134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.429097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de867c-1f39-40bf-8d7c-2c448ece3405 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.464730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.465479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.465760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.466036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.473298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.474756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3c415f07-285b-46d3-b987-258e52352aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:04.488572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:04.489726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:04.490697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:04.491140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c908d7-da34-4b63-9013-cb1847fb816c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.491232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 324/638] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:04.491316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22f5d-e65a-46be-9053-86aa108bb2ea None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.491580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22f5d-e65a-46be-9053-86aa108bb2ea None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.491804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22f5d-e65a-46be-9053-86aa108bb2ea None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.494054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 325/639] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:04.494054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e22f5d-e65a-46be-9053-86aa108bb2ea None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.503808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.534551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.535852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.536136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.536412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.547600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.549102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.559900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:04.566113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:04.567112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:04.568048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:04.568048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:04.568048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:04.568048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:04.568048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 315/640] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:04.568048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.606614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e22f5d-e65a-46be-9053-86aa108bb2ea None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.639675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848a36-6271-4126-b359-4568398bd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.640559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848a36-6271-4126-b359-4568398bd12c None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.640846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848a36-6271-4126-b359-4568398bd12c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.641158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be848a36-6271-4126-b359-4568398bd12c None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/56392bbbf8e449cfbcdddd6a492444bb/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.655973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848a36-6271-4126-b359-4568398bd12c None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=56392bbbf8e449cfbcdddd6a492444bb, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.657472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be848a36-6271-4126-b359-4568398bd12c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.667374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4600c0d-accf-4fb9-99b5-6213b329d756 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.671115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 326/641] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:04 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/56392bbbf8e449cfbcdddd6a492444bb/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:04.671907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848a36-6271-4126-b359-4568398bd12c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.712161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.712843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.713180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.713456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.714205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:04.714510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.716000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d92b8e-c469-4f9e-a164-a6bee452d527 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.732166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 316/642] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:04.732166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.732166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.732166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.749707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:04.750933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:04.772879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.798582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be848a36-6271-4126-b359-4568398bd12c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.816913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:04.841245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 317/643] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:04.842446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.849059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:04.849720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:04.850007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:04.850287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:04.851074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:04.851384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:04.852814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:04.865925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 327/644] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:04.866750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:04.965431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06b0f6-679c-48cd-98bb-d527d8ab8886 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:04.973492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c59cbe-127c-4e81-b0c7-57aa1f9088a1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.002136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.003763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.004197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.004704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.005639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:05.006104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.007697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.009130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.009924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.010209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.010487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.021509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 318/645] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:05.022456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.022679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.023922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.039989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:05.043342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:05.044242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:05.045393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:05.045393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:05.045393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:05.045393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:05.045393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 328/646] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:05.045393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.074533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.135607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46526d8e-36c8-4ba3-a7f4-c613bbc391e9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.151853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e7134-0e38-4198-9172-789952d727a0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.177459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.178652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.179365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.180083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.186498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.187159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.187501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.187720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.188556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=624366e88245426a8837e3ce0b714531) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:05.188867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.192276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.208959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/role_assignments?user.id=624366e88245426a8837e3ce0b714531&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:05.208959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.210837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:05.219366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:05.220411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:05.221392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 319/648] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:05.222233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.321693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.334615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.342019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bc5ef-7e54-4806-89f7-e89eee54c6df None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.353979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c10e-f41b-4b1b-9639-7d63f51c0694 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.385232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.386411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.387329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.387329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.387697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:05.389119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.389969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.403172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.403954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.404282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.404561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.407219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 320/649] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:05.409553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.414571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.415708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:05.431436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:05.432474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:05.433543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 330/650] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:05.434175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.547037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfca583-d20f-4ea0-90f8-bb1e79caf84c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.584362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ef1c7-5a42-4ffa-9798-f69743642f0b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.589299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.589982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.590267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.590544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.591293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:05.591600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.593000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.594606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.606301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 321/651] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:05.608978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.636705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.637831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.638305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.638740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.647216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.648863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:05.665558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:05.666735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:42:05.667731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:05.670302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 331/652] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:05.671284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.691798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.751273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780c61-b602-4b2c-9fe5-5b44c06de71d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.797759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.798407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b8ae9-ffd0-49e9-846c-7bde9aa09195 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.800589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.802038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.802557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.803629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:05.804139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.805856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.832062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 322/653] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:05.832973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.849297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.850291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.850573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.850851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.864959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.867123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:05.889408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:05.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:05.891264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:05.891264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:05.891264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:05.891264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:05.891500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.891576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 332/654] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:05.893570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:05.941849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bde6-b342-4904-ad7c-b41ff5ff962a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:05.970498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:05.980287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:05.980985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:05.981331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:05.981612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:05.982825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:05.982825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:05.984284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.004659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 323/655] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:06.005557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.027677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fb35a-d274-4ce2-a1cc-67308a59a219 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.066367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.067330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.067771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.068199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.120692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136ac0-5d52-484d-971f-8c3d8f646381 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.135461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.146902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.148623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.160690 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.161574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.161866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.162372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.162863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:06.163172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.164811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.177997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 324/656] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:06.178919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.216678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.264053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 333/657] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:42:06.265369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.286840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cae6-62fb-4f50-b63b-ef98c10f77f4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.323785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.324450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.324737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.325045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.374715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c9a4-ee79-405b-8b78-dfbeb451e7d3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.380354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.418554 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.418883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.419683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.419964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.420239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.421265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.429617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.431139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:06.448891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:06.449935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:42:06.450926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:06.453769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 334/658] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:06.454932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.484159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.554545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 325/659] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:42:06.555415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.589128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ef065-b95f-4b89-b857-474d0d3e6110 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.624612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.625495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.625723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.626005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.636338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.637833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.641291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:06.655698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:06.656828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:06.658140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:06.658140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:06.658140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:06.658140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:06.658140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 335/660] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:06.658140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.665862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce935e6-1093-46dc-b926-1a862f2b6612 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.703096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.704222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.704688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.705126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.706803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:06.707304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.709026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.733169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 326/661] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:06.733982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.735635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.766580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a116a1b-a5b1-4805-b73b-5a29331b8978 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.802925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.803725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.804007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.804286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.815437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.816897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:06.834548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:06.835572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:06.836469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:06.836469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:06.836469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:06.836469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:06.836469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 336/662] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:06.837141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.851856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df6fa9-e69e-44ac-b53e-b4d6245e3750 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.882472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.888868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.889615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.889842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.890118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.890835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:06.891141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:06.892514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92ffbc-9b1b-46df-a628-7b198d468d1f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:06.904109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 327/663] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:06.905406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfdb0-3f7c-4baf-ab47-2cc4bb45249f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.905694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfdb0-3f7c-4baf-ab47-2cc4bb45249f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.905969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfdb0-3f7c-4baf-ab47-2cc4bb45249f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:06.907427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 328/664] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:06.912171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bfdb0-3f7c-4baf-ab47-2cc4bb45249f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:06.950653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cbafe-070c-4757-82b9-212726f79d2e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:06.976731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:06.991518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9648e-fdee-4afc-bebc-5c5bba1ba0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:06.992189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9648e-fdee-4afc-bebc-5c5bba1ba0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:06.992475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9648e-fdee-4afc-bebc-5c5bba1ba0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:06.992747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9648e-fdee-4afc-bebc-5c5bba1ba0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.022677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bfdb0-3f7c-4baf-ab47-2cc4bb45249f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.058780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.059447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.059786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.060069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.060793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:07.061133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.062500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.072058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9648e-fdee-4afc-bebc-5c5bba1ba0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.073557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9648e-fdee-4afc-bebc-5c5bba1ba0b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.079386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 329/665] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:07.079386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.132348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.187123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 337/666] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:42:07.187587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f090c-a322-4d5c-8993-b75f835b7cef None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.188335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554b850-254e-4440-9d34-06763332cffd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.188623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554b850-254e-4440-9d34-06763332cffd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.188902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554b850-254e-4440-9d34-06763332cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.206058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9554b850-254e-4440-9d34-06763332cffd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:07.207570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9554b850-254e-4440-9d34-06763332cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:07.225922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.229470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.230349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.230670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.230973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.238637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.240096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:07.254605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:07.255541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:07.256470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 330/667] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:07.257696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.285848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 338/668] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:07.286693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554b850-254e-4440-9d34-06763332cffd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.372414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db6ac-86ba-46b7-87eb-642438930060 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.385068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.409550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554b850-254e-4440-9d34-06763332cffd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.411450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.413082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.413621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.413892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.421954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.423417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:07.437768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:07.438878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:07.439863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 331/669] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:07.440481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.448497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.449588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.450078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.450508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.462260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.463999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:07.482565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:07.483678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:07.484803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:07.484803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:07.484803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:07.484803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:07.486211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 339/670] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:07.487032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.498363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.551639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd49f0b-d174-4b7a-9e18-1eb3c54fe3c1 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.585319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.586056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.586423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.586699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.587475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:07.587783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.588833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14536-c5d0-45f2-aaaa-33ce12f600be None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.589241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.601889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 332/671] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:07.602855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.623475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.624269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.624548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.624825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.633190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.635616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:07.644217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:07.645230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:07.646104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 340/672] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:07.646821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.705962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd9bbf-39c9-44ca-ad08-049c14d88317 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.711550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.742243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.742896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.743179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.743449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.744213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:07.744514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.745970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028fce1-9d5f-4905-80c9-d30a52624bcf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.746845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484e43-bcc9-4750-b193-c42551a5a3e9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.759388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 333/673] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:07.760647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730df46-8516-44d3-a9a2-1d857b3909ef None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.760960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730df46-8516-44d3-a9a2-1d857b3909ef None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.761247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730df46-8516-44d3-a9a2-1d857b3909ef None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.764631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 334/674] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:07.764631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730df46-8516-44d3-a9a2-1d857b3909ef None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.787142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.787968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.788509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.788791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.789545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:07.789847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.791223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.803666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 341/675] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:07.804457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.857909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.870143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730df46-8516-44d3-a9a2-1d857b3909ef None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.903640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9c4f2-c3e6-43ee-a612-09a99c979f31 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:07.903866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.904564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.904848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.905150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.905995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=04a4d556adeb43139a65f61af0076091) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:07.906309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.907733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.914543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 335/676] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/role_assignments?user.id=04a4d556adeb43139a65f61af0076091&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:07.915311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:07.945969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.955844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:07.956582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.956808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.957126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.957879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:07.958183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:07.959573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6073d51-7d07-4f71-a4a3-b94f86add503 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:07.972362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 342/677] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:07.973687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.973983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.974264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.992954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:07.994216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:08.033143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9657-51ae-41c0-8503-57cccdc8b0dc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.076952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 343/678] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:08.076952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.081682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.082522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.082906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.083321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.084723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=dbd8ecdcc21f4d22b969036c1d7a3672) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:08.085061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.086505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.094004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 336/679] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:07 2022] GET /identity/v3/role_assignments?user.id=dbd8ecdcc21f4d22b969036c1d7a3672&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:08.094160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.121748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:08.219636 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862caf6-7faa-4568-a9e5-382db88143b2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.245497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:08.245972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f922d-2faf-4c49-883c-4fbdb1162412 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.275822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.276628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.276910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.277215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.285080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.286755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.287559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.287693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.287932 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.288104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.300973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.302091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:08.305039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:08.305930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 344/680] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:08.309385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:08.323552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:08.324571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:08.325577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:08.325577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:08.325577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:08.325577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:08.325577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 337/681] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:08.325867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.425212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:08.460263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcdaa2-8ef2-4729-83b4-971a3f93935c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.465945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ddbd0-b8d4-4d3c-bf2a-06f6b3671003 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.503737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.505215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.505686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.506172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.508973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.509820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.510169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.510496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.511350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:08.511723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.513293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.520323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:08.529973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:08.530957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:08.531858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:08.532517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 338/682] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:08.534317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.535634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 345/683] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:08.542401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.600103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:08.659626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e251-6547-4ddb-9172-96bbd87f018b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.688958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e25c80-4ec2-444e-b991-93e97b2cce41 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.694379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:08.702320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.703007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.703296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.703578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.704313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:08.704631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.707584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.724720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 339/684] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:08.725806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.729501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.730406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.730935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.731470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.732546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=39aef7668f15405b8d665fe61e6a49c4) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:08.733083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.734905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.742907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 346/685] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/role_assignments?user.id=39aef7668f15405b8d665fe61e6a49c4&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:08.744092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.871687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aaa69c-97b0-4e99-a879-11598c8db6e7 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.933294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6a10-29de-4607-89a8-68583600c621 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:08.936676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:08.939183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2029236-2540-4388-b833-471f9fca730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.941015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2029236-2540-4388-b833-471f9fca730e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.941581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2029236-2540-4388-b833-471f9fca730e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.942054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2029236-2540-4388-b833-471f9fca730e None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:08.942998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2029236-2540-4388-b833-471f9fca730e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:08.943521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2029236-2540-4388-b833-471f9fca730e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:08.945405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2029236-2540-4388-b833-471f9fca730e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:08.963598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 340/686] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:08.968916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2029236-2540-4388-b833-471f9fca730e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:08.988339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:08.989179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:08.989516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:08.989790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.000761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.003255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:09.023855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:09.024836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:09.025868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:09.028689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 347/687] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:09.034826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.043239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:09.101513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2029236-2540-4388-b833-471f9fca730e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.161979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.162799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.163081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.163609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.170194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30f6-80c6-42f7-9007-e2f7a845bd64 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.184572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.186114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.212370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.213082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.213371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.213648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.214493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:09.214804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.216370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:09.217376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:09.218272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:09.219198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:09.219198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:09.219198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:09.219198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:09.230332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 341/688] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:09.235760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.236807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 348/689] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:09.242451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.265855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:09.354339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f229c-404c-4323-b15b-c7e4d115d4b6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.392252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.393898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.394358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.394713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.450984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fcfc-3ba9-41a1-8499-f79d60eec09b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.458142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:09.473104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.474788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.497468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:09.538026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.539361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.541187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.541654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.543326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:09.543784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.545976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.569799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 342/690] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:09.574597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.645467 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 349/691] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:42:09.649550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.803262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960e5a9-bfbc-4082-9728-3b39c082e3e0 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.824940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f6f14-b789-43a7-a206-6c206897c8da None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.847118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:09.862945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.863789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.864115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.864394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.875804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.877396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:09.896412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:09.897392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:09.898298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:09.898298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:09.898298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:09.898298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:09.898298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 350/692] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:09.903280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.914489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.915293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.915571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.915897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.933695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.935148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:09.958395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:09.959411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:09.960375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:09.964262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 343/693] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:09.965545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.994568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:10.077362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151e9c-9b67-475e-a1e6-3ef375f8a5b0 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.151950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.152552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.152830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.153188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.154022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:10.155798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.157263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.171996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461e5e9-c55c-4ee9-b927-2f099ea606e6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.197534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 344/694] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:10.199792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.265393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.266278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.266559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.266829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.267553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:10.268491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.271238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.301120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 351/695] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:10.306275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.318539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:10.344464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cf848-a182-4c95-937f-7339678be042 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.351088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:10.393691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5178e1-b6e2-4e65-b703-3dc443b84f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.394430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5178e1-b6e2-4e65-b703-3dc443b84f54 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.394767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5178e1-b6e2-4e65-b703-3dc443b84f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.395042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5178e1-b6e2-4e65-b703-3dc443b84f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.465120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b3fc-8a4a-4ebd-bd9c-e7e60fc1f0a7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.467059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5178e1-b6e2-4e65-b703-3dc443b84f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.468535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5178e1-b6e2-4e65-b703-3dc443b84f54 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.521863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.523097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.523548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.523991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.539459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.543416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.555296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:10.575413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:10.576373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:10.577307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:10.584177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 345/696] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:42:10.585384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 352/697] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:10.585741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be7738-044a-4878-9666-e2e6c24f3ac8 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.586034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be7738-044a-4878-9666-e2e6c24f3ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.586309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be7738-044a-4878-9666-e2e6c24f3ac8 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.587085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.588140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 346/698] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:10.588835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be7738-044a-4878-9666-e2e6c24f3ac8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.705862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be7738-044a-4878-9666-e2e6c24f3ac8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.719394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:10.730692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f09b0-60d3-4ad2-883f-996d17af5aa0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.744892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.745813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.746097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.746374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.756770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.758256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.772862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.776139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.776139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.776139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.776139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:10.776139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.776655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd695c-e8f5-4db8-9551-ca7a77f67f61 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-8c9b3c93-d159-4dce-9b0b-0dc5463c3ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:10.778844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:10.779802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:10.780720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:10.780720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:10.780720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:10.780720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:10.781004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 347/699] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:10.782189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.782474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.782750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.794544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 353/700] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:10.796462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911641-22fe-4fcc-a2ec-4d5c4b90f966 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.796981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911641-22fe-4fcc-a2ec-4d5c4b90f966 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.797507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911641-22fe-4fcc-a2ec-4d5c4b90f966 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.799964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 354/701] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:10.800992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911641-22fe-4fcc-a2ec-4d5c4b90f966 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.803419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:10.806010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:10.836194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:10.883204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 348/702] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:10.884318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.922414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911641-22fe-4fcc-a2ec-4d5c4b90f966 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.962607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.963303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.963584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.963855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.964742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:10.965118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.966502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6e492-dd42-456a-847f-cdad214d810e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.978712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 355/703] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:10.979944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.980232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.980503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.998924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:11.000118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:11.008201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.026882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b77fd-cbc6-4cad-bbc3-6d43dc0c8cfa None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.067607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.068270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.068553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.068827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.069684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=56392bbbf8e449cfbcdddd6a492444bb) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:11.069991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.071426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.081133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 356/704] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:11.081133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.097429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 349/705] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/role_assignments?user.id=56392bbbf8e449cfbcdddd6a492444bb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:11.098657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.157335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.210684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d956d2-9a54-4329-b39f-f22b9957ead4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.255027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.256109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.256524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.256893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.257810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.260233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.264915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913cc9-319e-4fff-8726-577f701ee4de None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:11.275972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:11.277267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:11.278437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 357/706] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:11.279420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.288894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.318333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.319269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.319552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.319829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.328679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.330226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:11.349707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:11.350651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:11.351551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 350/707] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:11.352560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.423271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37f3a4-58b4-4fa8-b7b1-74b9bab74ed1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.458014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.461895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.462691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.462981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.463258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.471620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cde4f-6eb1-4593-b5ae-1a8b080507fc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.474687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.476166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:11.493753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:11.494879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:11.495830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:11.495830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:11.495830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:11.495830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:11.495830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 358/708] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:11.496277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.513516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.514110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.514390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.514662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.515363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:11.515670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.517080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4824-0bbe-4aef-bbeb-5e7aa147c40d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.522400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 351/709] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:11.523604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303779-80c3-4522-9ed8-01a165690d31 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.523890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303779-80c3-4522-9ed8-01a165690d31 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.524162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303779-80c3-4522-9ed8-01a165690d31 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.525586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 352/710] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:11.529989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303779-80c3-4522-9ed8-01a165690d31 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.566523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.614780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78616689-c8a8-47e6-8a10-8a8bebbdd68e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.637525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303779-80c3-4522-9ed8-01a165690d31 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.652289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.653081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.653368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.653658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.654426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:11.654730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.656422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.675658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 359/711] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:11.675658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.681216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.681897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.682178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.682452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.683177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:11.683479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.687072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ec53-700e-4612-b12d-c1c64606ce82 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.699577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:11.700820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.701133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.701403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.720041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:11.721380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:11.729347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.796609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 354/713] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:11.797489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.811648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9e213-dbff-4bd4-ba4f-bba3518de491 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.834255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:11.851973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.853044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.853044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.853271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.853899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:11.854202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.855569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.868975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 360/714] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:11.868975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:11.929699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da884d0-f123-402a-8dbd-0421f89cc95d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.981544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c4cc-de48-4dd8-beb9-1d464b39c4a2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:11.981778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:11.982610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.983274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.983644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.985641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=624366e88245426a8837e3ce0b714531) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:11.986068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:11.988489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:11.997436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 355/715] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/role_assignments?user.id=624366e88245426a8837e3ce0b714531&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:11.999103 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:12.010999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:12.034805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:12.035829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.036107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.036378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.037206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:12.039596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:12.076060 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 361/716] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:42:11 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:12.150811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5020a-7391-44ef-b3ef-31db8ebb5e04 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:12.198915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:12.199742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.200022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.200292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] PATH_INFO: `/v3/services/network` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.201055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:12.202499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:12.217821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:12.218934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:12.219807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 356/717] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:12.227964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:12.300809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:12.371114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c4408-875d-4061-b6e9-7dc544d9dcd4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:12.409175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:12.409947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.410236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.410519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.411234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] RBAC: Adding query filter params (name=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:12.411544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:12.413083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8a8f6-a696-46a2-b00b-1e35b7c34d92 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:12.418505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 362/718] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:12.424744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:12.506406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:12.543590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fd934-351d-4f5d-876d-c2dd21b37056 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:12.582190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:12.583174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.583687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.584163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.585085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] RBAC: Adding query filter params (type=network) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:12.585594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:12.587164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5967-2e49-43a3-a592-650d45e5c264 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:12.593817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 357/719] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:13.490175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f6c4e-acec-42b5-a306-0f12151215fb None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:13.490698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f6c4e-acec-42b5-a306-0f12151215fb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:13.490779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f6c4e-acec-42b5-a306-0f12151215fb None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:13.492312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 363/720] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:13.513210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:13.513689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:13.513782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:13.538176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:13.539660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:13.619366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 358/721] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:13.664478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f6c4e-acec-42b5-a306-0f12151215fb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:13.829691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f6c4e-acec-42b5-a306-0f12151215fb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:13.831811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:13.886918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:13.887718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:13.888001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:13.888274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:13.910212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:13.918258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:13.920604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:13.922785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 364/722] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:13.927661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.008008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:14.052527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb27b2-4aca-4c76-892c-04b439c8dc93 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.087769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.088440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.088723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.089025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.089768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:14.090073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.091440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.101031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 359/723] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:14.106261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.231118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c237ef-e153-4647-8f2e-2fa2046c5d26 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.276241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.277110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.277399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.277676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.292720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.294220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-60700424-c31d-4a94-b2ab-77f65e11e33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:14.318432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:14.320726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:14.322959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:14.322959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:14.322959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:14.322959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:14.322959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 365/724] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:14.326314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.438799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cd598-04d2-4496-b68f-cbdcfcbce901 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.439146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cd598-04d2-4496-b68f-cbdcfcbce901 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.439380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cd598-04d2-4496-b68f-cbdcfcbce901 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.442006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 366/725] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:14.448623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983300c-758c-4074-80a8-ff2b37f6713e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.448623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983300c-758c-4074-80a8-ff2b37f6713e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.448623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983300c-758c-4074-80a8-ff2b37f6713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.456775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2101597-88a2-4971-b344-ba24f981610f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.477976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c983300c-758c-4074-80a8-ff2b37f6713e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:14.479532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c983300c-758c-4074-80a8-ff2b37f6713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:14.484954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:14.496084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.496699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.497017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.497303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.498024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:14.498332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.499550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:14.500783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.515591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 360/726] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:14.525935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.589993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 367/727] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:14.591624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cfa38-c955-431b-92b6-d7550f3aa8db None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.591914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cfa38-c955-431b-92b6-d7550f3aa8db None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.592250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cfa38-c955-431b-92b6-d7550f3aa8db None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.598587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 368/728] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:14.599919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.600211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.600488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.621073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:14.622424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:14.658885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b822b-a930-4d7f-af1d-fb64e718c7cf None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.694896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.696160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 369/729] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:14.696279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.696845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.697552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.701024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.705791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.707551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:14.723738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:14.724803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:14.725857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:14.728677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 361/730] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:14.733703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.788922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:14.811568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:14.838032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545c258-411c-4446-aaac-5f32783df063 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.840874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5da39e-cfcf-4f3c-8186-5dd264fb70fe None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.875501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.876181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.876466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.876743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.877829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:14.878218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.879691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883626-73a5-4f5b-b9e7-80e2e359f5e9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.880528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.881519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.882007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.882537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.883459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.885076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.907003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 370/731] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:14 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:14.908813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.020321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 362/732] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 5 20:42:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:15.021910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94cee6-757b-4286-bcf3-7b5d59b2a1c0 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.022200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94cee6-757b-4286-bcf3-7b5d59b2a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.022475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94cee6-757b-4286-bcf3-7b5d59b2a1c0 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.024157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 363/733] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:15.030455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.030788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.031068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.054976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:15.055510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1be93-5af4-4b66-8286-931965a2261a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.056174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:15.101877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.108804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.109731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.110189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.110643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.128220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:15.135867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:15.136850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:15.137800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 371/734] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:15.138518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.158598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 364/735] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:15.159712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.208715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.252532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68683-737c-4286-9c16-b099a2f7c5eb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.297940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1e02-6089-48f8-ac4b-3d4633b4ffc2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.299720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9b4aa-0302-40a7-9511-26dab292fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.300797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9b4aa-0302-40a7-9511-26dab292fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.301950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9b4aa-0302-40a7-9511-26dab292fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.302233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9b4aa-0302-40a7-9511-26dab292fbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.341726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.342502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.342854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.343204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.344017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:15.344390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:15.346560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:15.355738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 365/736] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:15.356721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.388722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.403986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9b4aa-0302-40a7-9511-26dab292fbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:15.406511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9b4aa-0302-40a7-9511-26dab292fbd7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:15.466584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.475823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcda66-5aa1-4d47-9ad4-96fef7c7b738 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.512518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.513353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.513633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.513902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.525353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:15.533148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:15.534316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:15.535354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 366/737] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:15.536128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.538105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 372/738] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:42:15.540297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8a48-dd2e-42f9-821f-73afa2625043 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.540742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8a48-dd2e-42f9-821f-73afa2625043 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.541246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8a48-dd2e-42f9-821f-73afa2625043 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.543006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 373/739] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:15.543883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8a48-dd2e-42f9-821f-73afa2625043 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.648633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.652397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da7929-c868-475d-a72f-956a556d1395 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.661439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8a48-dd2e-42f9-821f-73afa2625043 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.697517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.698346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.698626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.698899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.709959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:15.710564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.711418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:15.711655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.712125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.712618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.713739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:15.714530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:15.716081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c5af2-37ba-4033-9bc0-910eb67b0f2f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:15.730750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:15.731684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:15.732598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:15.732598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:15.732598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:15.732598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:15.732598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 367/740] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:15.732598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.733521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 374/741] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:15.734429 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.734720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.735573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.747154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.754642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:15.755862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:15.828210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 375/742] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:42:15.837816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.847402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b03f7-6120-41db-ae9f-e2c33d99103f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.883367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.884353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.884477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.884688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.895627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:15.897104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:15.915434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:15.916373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:15.917351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:15.917351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:15.917351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:15.917351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:15.917351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 368/743] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:15.917351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.934886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.954295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0b658-b104-4a53-b96e-e84d2258a13d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.981180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:15.996655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.997380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.997660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.997944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.998656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:15.998958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.000317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.012324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 376/744] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:16.012986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.030194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c7fa-f2a8-4cb1-b103-20ac9ea02026 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.066842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.067636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.067914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.068186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.079612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.081432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:16.100356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:16.101367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:16.102281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:16.102281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:16.102281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:16.102281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:16.102281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 369/745] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:16.103119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.132325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fd4b3-09cc-4087-bc6c-8c17d9d9ba18 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.170474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.171061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.171349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.171635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.172365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.174532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.196962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 377/746] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:16 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:16.196962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.200469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:16.230566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2d767-88f2-45eb-8d5e-e3c7012bb3db None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.253403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:16.305343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.306048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.306411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.307254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.308139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:16.308594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.310379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.326107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff23b-1b03-484f-b470-8d79e3024f45 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.327521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 370/747] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:16.328572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.365835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.366686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.366929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.367212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.376525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.378889 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:16.397258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:16.398267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 378/748] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:16.399220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.454413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d13977-a376-44e3-b645-20397145b6ac None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.468045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:16.500042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.500717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.501295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.501581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.503213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:16.503570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.505751 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.513227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9336f-adea-4393-8a9c-06f43fba9025 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.522971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 371/749] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:16.523892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.555353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.556248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.556642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.557035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.564802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.566391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:16.586367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:16.587336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:16.588275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 379/750] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:16.589192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.589460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:16.651265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87f46-996f-4657-80d4-291e9e18be61 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.691002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.691947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.692335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.692712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.693700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:16.694127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.695847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.701231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e085f-12e0-466f-8b25-68ebb6eba216 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.721565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 372/751] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:16.721565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.731030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:16.743875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.744995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.745474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.745940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.753805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.755531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:16.772191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:16.773301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:16.774277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:16.778371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 380/752] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:16.779151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.821342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:16.840949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056af5c-0783-49fd-a75d-cb778e504ecd None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.878293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.879259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.879259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.879537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.880279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:16.880587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.882113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.895283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 373/753] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:16.896158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.919416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6152c-b92f-4a3c-a18d-9f2bcb5ea077 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.968463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.969914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.971624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.972469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.987023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.989584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.011477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb75d5-cc69-415b-82fb-0d4d00087c38 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:17.011768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:17.012639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:17.013598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:17.013598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:17.013598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:17.013598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:17.013598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 381/754] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:17.014652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.053571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.061362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.063391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.064645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.065327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.066452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:17.067072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.068867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.089083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 374/755] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:17.090234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.094201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.125768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dee84-3965-4620-973e-10eff83ec94f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.167177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.167841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.168131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.168411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.169275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=56392bbbf8e449cfbcdddd6a492444bb) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:17.169593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.171596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.189292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 382/756] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/role_assignments?user.id=56392bbbf8e449cfbcdddd6a492444bb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:17.189292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.213463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582540e-b3b4-4391-a644-07fd72834551 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.263324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.264026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.264675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.265051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.266828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:17.267274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.268968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4787-58de-40c8-b6cb-94217c87ce90 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.286413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 375/757] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:17.287896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144184a6-19f9-4aa8-bdcb-17f2bb01ba40 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.288523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144184a6-19f9-4aa8-bdcb-17f2bb01ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.288872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144184a6-19f9-4aa8-bdcb-17f2bb01ba40 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.290523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 376/758] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:17.291342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144184a6-19f9-4aa8-bdcb-17f2bb01ba40 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.304367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.308819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b7041-b397-407d-9751-b72627870cc6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.348355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.349134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.349486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.349838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.383974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.435800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144184a6-19f9-4aa8-bdcb-17f2bb01ba40 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.438962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.441103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.486776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.487998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.488279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.488758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.497759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.500065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f0077adf-5461-45f0-b9c3-d362e98708fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:17.518266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:17.519204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:17.520122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:17.520564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 377/759] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:17.525531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.525531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.525531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.544022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:17.545233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:17.545420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 383/760] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:17.545771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.549205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.632833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 378/761] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:17.633851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.682077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661eb439-2b0a-4726-a99e-a30e3cccf9df None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.712878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.728437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.729707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.730220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.730940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.733223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:17.733745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.735379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.757687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 384/762] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:17.758388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.781495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880c6f6-36e0-40e1-85c2-1c1bcd6423cc None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.824203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.825501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.826084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.826561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.838589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:17.839908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.841826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:17.862304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:17.863270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:17.864221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:17.864221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:17.864221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:17.864221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:17.866655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 379/763] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:17.867614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.886703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d44a1-2c8b-43dc-b679-8078c81d09f9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.924254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.925143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.925434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.925858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.926568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.928223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:17.944235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:17.945301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:17.946170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 385/764] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:17.947052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.992467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc531-d21e-499d-b10f-e674a5db5f4b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.000520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.035804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.037112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.037600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.038068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/624366e88245426a8837e3ce0b714531/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.040516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=624366e88245426a8837e3ce0b714531, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.042644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.061210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 380/765] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:17 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/624366e88245426a8837e3ce0b714531/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:18.062600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.072963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123167-3250-414c-980e-c4c6eaa1d2dc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.094775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.108140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.108814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.109172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.109448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.110279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:18.110571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.117451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.132958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 386/766] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:18.132958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.234429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4fb77-b065-477d-937f-f819a38a2cc9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.283630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.284722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.285241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.285730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.286769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:18.287292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.290889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.301618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 381/767] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:18.307565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.321740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2038fe-2894-48fa-87f2-2e3390e409d5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.355944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.385802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.387051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.387546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.388017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.404596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.406682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.438361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261a9ee-f664-4453-a36f-683af996b8ed None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:18.442912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:18.443860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:18.444761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:18.447336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 387/768] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:18.453023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.478874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.479647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.480018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.480468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.481403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:18.481756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.483201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e450d06c-764f-4e67-adf9-4c46933a8a56 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.489675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 382/769] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:18.491138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed935-76a6-4c00-8814-15552353136a None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.491495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed935-76a6-4c00-8814-15552353136a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.491843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed935-76a6-4c00-8814-15552353136a None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.493490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 383/770] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:18.495163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed935-76a6-4c00-8814-15552353136a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.523364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.599717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926edcd7-33ca-4949-ac83-277c693f4afa None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.614787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.623502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed935-76a6-4c00-8814-15552353136a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.640082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.640743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.641053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.641328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.642109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:18.643027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.644681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d382a5c-3df3-46dc-8191-474ba41cfbd8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.662133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 388/771] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:18.663494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.663943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.664070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.664263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.665149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.665956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.666427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.667414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] RBAC: Adding query filter params (interface=public, service_id=5ec3c827d4064fdc8040f8b81c1bdf95, region_id=RegionOne) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:18.667964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.669568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.678398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 384/772] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/endpoints?service_id=5ec3c827d4064fdc8040f8b81c1bdf95&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:18.679567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.681014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:18.682397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:18.765992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 389/773] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:18.767050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.814964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1458f-3526-4dc9-b9a6-26ec4bb93289 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.820573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.854910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.855990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.856515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.857012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.858194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=71519a4d3c414dd88bad0afdf727a521) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:18.858822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.860443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.867350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 385/774] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/role_assignments?user.id=71519a4d3c414dd88bad0afdf727a521&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:18.868487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.900339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:18.913620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04884d-5e37-4814-aaf3-74b9c0a8e1b3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.960707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.962136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.962656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.963199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.964109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.968528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.985188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 390/775] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:19.022390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67777-6edc-498a-bea6-6d914969bc39 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:19.074830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:19.075645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.075924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.076193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] PATH_INFO: `/v3/services/network` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.076850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:19.078356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:19.091477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:19.092597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:19.093529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 386/776] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:19.099537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:19.241249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:19.249597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21938d6-495d-46be-9e31-e927f7b66103 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:19.294338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:19.295025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.295310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.295592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.296315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] RBAC: Adding query filter params (name=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:19.296623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:19.298037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf7979-373d-4119-8c2f-8afd8651d5ed None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:19.305914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 391/777] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:19.311547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:19.365286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd534-f0da-4405-b2a4-a9e305eb371c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.365611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd534-f0da-4405-b2a4-a9e305eb371c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.365838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd534-f0da-4405-b2a4-a9e305eb371c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.367870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 392/778] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:19.378061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.378342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.378764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.465806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:19.493636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334e9f4-7ea2-4500-baa4-26a4f28ea40f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:19.554745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:19.555968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:19.593732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:19.594427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.594708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.594979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.595953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] RBAC: Adding query filter params (type=network) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:19.596312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:19.597755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:19.612966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 387/779] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:19.618547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:19.644430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 393/780] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:19.669209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:19.785358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:19.803904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17950aff-f3a1-4882-8331-4b3781f3ec24 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:19.820943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502664-0514-494c-bf25-a118a1bdc256 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:19.871650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:19.872455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.872737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.873035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.886472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:19.887130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:19.887413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:19.887686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:19.888471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] RBAC: Adding query filter params (interface=public, service_id=c358e6a19c9145bc864f2b607e36961e, region_id=RegionOne) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:19.888778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:19.894368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:19.896731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:19.904841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 388/781] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:19 2022] GET /identity/v3/endpoints?service_id=c358e6a19c9145bc864f2b607e36961e&interface=public®ion_id=RegionOne => generated 194 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:19.910393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:19.911234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:19.912191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:19.913086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 394/782] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:19.925137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:19.945263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:20.035802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028307f-9370-4cca-8a81-6c17f5f9e75b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.073179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.073856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.074139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.074417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.075227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:20.075533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.076991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.086239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 395/783] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:20.091682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.108322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:20.110545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ad226-602d-4f7c-bb48-8a6087cef523 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.176542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.177257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.177536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.177811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.178498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.179921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.185733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 389/784] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:19 2022] GET /identity/v3/services => generated 772 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:20.205995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef83c2-1f75-443d-8f91-73a4f8420ce0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.246942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.247757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.248039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.248309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.261697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.263183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:20.284600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:20.285612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:20.287041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:20.287041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:20.287041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:20.287041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:20.287041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 396/785] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:20.292742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.405630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:20.427404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e449174-6f05-4d57-9a14-bb252ac2544a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.463504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.464522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.465072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.465545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.466544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:20.467044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.468599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.481194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 390/786] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:20.487615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.563291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:20.617839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5856715-86bf-435e-928c-fcfd3e08b157 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.653107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.653964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.654250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.654523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.664010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.665503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1d780415-0da2-44c9-a512-9b4b1730e9ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:20.681821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:20.682839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:20.684410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 397/787] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:20.689087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.749350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3acbac-bd8a-42d2-8f64-7394dd86bafa None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.749692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3acbac-bd8a-42d2-8f64-7394dd86bafa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.749900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3acbac-bd8a-42d2-8f64-7394dd86bafa None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.751263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 398/788] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:20.756837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.757144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.757416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.788607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:20.790083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:20.822254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f6356-2b90-41df-b5c8-a598f9004503 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.869804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 399/789] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:20.881109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.881791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.882074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.882351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.883183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:20.883550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.885078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.894299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:20.905659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 391/790] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:20.910196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.928342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.989978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.077457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927568f9-1e50-4378-a369-a5a317d65ed5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.125731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab11a-b5df-4f75-8b32-2b2857571957 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.150656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.151463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.151746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.152025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.174415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:21.188460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:21.189638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:21.190515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:21.192080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 400/791] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:21.203126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.207955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.207955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.207955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.207955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.235848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:21.237769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:21.264597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:21.265608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:21.266534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:21.266534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:21.266534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:21.266534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:21.269959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 392/792] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:21.276088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.337476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.398498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bc8ff-dda7-425e-bc62-84e9059fe72e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.404195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c293a-37a4-45f1-84ca-2d05515af1fb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.414370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.436026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.436799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.437268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.437524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.438595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:21.438708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:21.441044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6a5b6-7fbc-4f40-8958-87903a067a01 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:21.450239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 401/793] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:21.451678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6560d-28d4-430d-95ed-49715abf73ff None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.452061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6560d-28d4-430d-95ed-49715abf73ff None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.452419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6560d-28d4-430d-95ed-49715abf73ff None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.452681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.453569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.454044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.454558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.456537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:21.457102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:21.458864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 402/794] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:21.459116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5939f75-ffac-46ca-9ce2-77b939fd5963 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:21.459817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6560d-28d4-430d-95ed-49715abf73ff None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.479911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 393/795] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:21.479911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.479911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.479911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.503135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:21.505539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:21.585242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 394/796] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:21.586100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.594541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6560d-28d4-430d-95ed-49715abf73ff None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.636977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.637537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.637821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.638098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.650232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:21.651714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:21.656053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:21.671004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:21.673199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:21.675927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:21.675927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:21.675927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:21.675927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:21.675927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 403/797] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:21.675927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.707499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.735588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ec301-0638-470c-8845-34ce50b3b21e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.773238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.774105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.774391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.774691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.781901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:21.783401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:21.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:21.798978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:21.799909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 395/798] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:21.800651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.804024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e2e16-1db8-416a-b293-97bf34993c73 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.844809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177381a4-4aac-4b7c-adbb-9e66b8100b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.845595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177381a4-4aac-4b7c-adbb-9e66b8100b9b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.845920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177381a4-4aac-4b7c-adbb-9e66b8100b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.846229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177381a4-4aac-4b7c-adbb-9e66b8100b9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.857586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177381a4-4aac-4b7c-adbb-9e66b8100b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-177381a4-4aac-4b7c-adbb-9e66b8100b9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:21.865903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:21.866972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:21.867868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 404/799] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:21.868607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d036c-876c-4db9-95ff-b6da6d3beed8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.868607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d036c-876c-4db9-95ff-b6da6d3beed8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.869560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d036c-876c-4db9-95ff-b6da6d3beed8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.870259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 405/800] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:21.870841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d036c-876c-4db9-95ff-b6da6d3beed8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:21.918984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.924105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddef81-70c5-4938-8bdb-779d3fa56823 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.961081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:21.962182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:21.962902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:21.963233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:21.963534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:21.964303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:21.964606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:21.966163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:21.975965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d036c-876c-4db9-95ff-b6da6d3beed8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:21.979645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 396/801] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:21.980271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.015387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.016141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.016318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.016589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.018031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:22.018337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.019750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d68aba-6d28-4b87-b30d-b29c7a87cb7d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.036654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 406/802] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:22.036654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.036654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.036654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.051162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:22.052333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:22.092456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387e127-c132-4657-a9a7-b69fdb3eef9b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.133031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 407/803] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:22.133031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.138866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.139680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.139959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.140229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.141018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:22.141410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.142800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.152164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 397/804] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:22.152791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.177551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.221219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.245171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6fd9-486f-4be4-ba73-593d7bc70d50 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.261761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712edfc-8377-4d83-8482-0db83dfdc800 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.281151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.281954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.282241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.282518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.290597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.292056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.297786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.299259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.299539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.299813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/56392bbbf8e449cfbcdddd6a492444bb/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.301793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=56392bbbf8e449cfbcdddd6a492444bb, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.303213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:22.307470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:22.308700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:22.309765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 408/805] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:22.313817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.321918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 398/806] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:22 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/56392bbbf8e449cfbcdddd6a492444bb/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:22.322922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.434009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.447330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d3ee6-08a1-4819-9a3b-a2536ce4eba4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.458642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53cfd-547f-436c-b924-17b4388a5803 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.490548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.491518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.491802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.492080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.492760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.494328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.503909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.505197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.505701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.506194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:22.509785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:22.510784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:22.512049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 409/807] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:22.512961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.520079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.524988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.526813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:22.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:22.547356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:22.548387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:22.548387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:22.548387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:22.548387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:22.548387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 399/808] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:22.549228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.661524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39810e-1dad-4e1c-bed3-3581376682e3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.667315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ec6c-f302-46cc-90fc-f37dfc716b14 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.697827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.698429 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.698720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.699222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.699665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.699839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:22.700135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.701703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fef81e-d4db-4d99-8f35-b343b068b90b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.706169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.706834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.707120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.707395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.708097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:22.708406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.709808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.718956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 400/809] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:22.718956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.730153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 410/810] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:22.734708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c736-ef2b-4638-b148-3b27f469d1f5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.734708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c736-ef2b-4638-b148-3b27f469d1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.734708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222c736-ef2b-4638-b148-3b27f469d1f5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.737288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 411/811] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:22.738875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c736-ef2b-4638-b148-3b27f469d1f5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.808177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.825870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c1664-4b55-459b-bd9a-d101327a8207 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.853585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222c736-ef2b-4638-b148-3b27f469d1f5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.864238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.864909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.865224 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.865500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.866220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:22.866534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.867900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.880972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 401/812] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:22.881772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.903078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.904173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.904456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.904866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.905722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:22.906166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.908672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a9572-cec2-43ed-8c57-a14fccd4ea47 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.917071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 412/813] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:22.918434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.918790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.919135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.935256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:22.936431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:22.944610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:22.990399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d883-8e06-4e63-b715-72157c8a3dd4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.020953 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 413/814] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:23.020953 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.026818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.027473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.027752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.028025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.083238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.108391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.110416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.128960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7f3a-d0e3-4d45-9b95-4806dfb2e3de None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.165817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.166664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.167475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.167730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.167981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.176914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.178483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:23.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:23.195659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:23.196618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 414/815] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:23.197812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.220945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 402/816] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:23.220945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.300696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0ac6b-0e48-49db-888e-5fd4e848cd19 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.315332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.322210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67b3bb-a42c-4d4f-bee2-01d6c3a9f6cb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.337353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.338100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.338362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.338628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.339389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.340737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.357478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.358350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.358698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.359037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] PATH_INFO: `/v3/services/network` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.359752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.361822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.371556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 415/817] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:23.371556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:23.374232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:23.375500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:42:23.377277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:23.383807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 403/818] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:23.384863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.412559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.510204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8672d1d-e32f-4965-a5b7-2cd21a64876b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.547016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c548d4-3aee-4c4a-9c04-0ae418f8447d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.553587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.554575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.555002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.555415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.572132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.574223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.589015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.589892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.590305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.590678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.591620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:23.592030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:23.593509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:23.594613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:23.596346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:23.596346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:23.596346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:23.596346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:23.596634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.596732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 404/819] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:23.596732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.624012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 416/820] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:23.625039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.650443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.683713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.717381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a8285-45cc-47f8-8a5f-a4b96aec9aa6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.729938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799182f2-52dd-459b-b043-6c8100e9fa56 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.772872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.776274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.776914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.777366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.777788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.778665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] RBAC: Adding query filter params (name=network) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:23.779134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.779251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.779537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.779881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.780758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:23.781152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.781492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.782913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.787417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 405/821] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:23.788753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.800432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 417/822] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:23.801450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.889705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.892023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8df2b1-c5b8-4a5f-bad5-713a13030f4f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.907628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bd941-f8e3-4b8c-921d-4a7df57d7ac8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:23.929151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e6788-9710-4e75-8193-833364054077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.930240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e6788-9710-4e75-8193-833364054077 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.930710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e6788-9710-4e75-8193-833364054077 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.931145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e6788-9710-4e75-8193-833364054077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.934219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:23.943277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e6788-9710-4e75-8193-833364054077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.944788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e6788-9710-4e75-8193-833364054077 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.955152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:23.956049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:23.956481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:23.956953 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:23.957994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:23.958444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:23.959947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b71e6788-9710-4e75-8193-833364054077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:23.964465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:23.965603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:23.966559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:23.966559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:23.966559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:23.966559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:23.967384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 406/823] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:23.968328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e6788-9710-4e75-8193-833364054077 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:23.968743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 418/824] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:23.976851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.072900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e6788-9710-4e75-8193-833364054077 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.113863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.114660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.114938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.115205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.121102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b72db-b63e-490b-b851-2422aed5a6b6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.122317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.123889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:24.139107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:24.140105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:24.141093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 407/825] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:24.141585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.158548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.159618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.159921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.160202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.161264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:24.161576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.163722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.182609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 419/826] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:24.183851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.196557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:24.201368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:24.268454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1b967-245f-49cd-a5b7-178005e486b6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.297598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b18aa-a457-44d4-a8ea-546f9a5e73ec None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.317227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.317901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.318188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.318470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.319213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.321143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.336809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.337596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.337980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.338288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.339264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:24.339572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.341109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.349644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 408/827] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:24.351310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.354176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 420/828] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:24.360756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.443090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:24.483119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21e52-0347-4a02-a870-b431c0060b87 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.499251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:24.506404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4839-0bde-422a-ac4b-62cc23c3052f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.539906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.540918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.542385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.542895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.543927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=624366e88245426a8837e3ce0b714531) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:24.544634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.549912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6711b-27df-4565-9d0e-87f3dcc553d8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.563067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 421/829] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:24 2022] GET /identity/v3/role_assignments?user.id=624366e88245426a8837e3ce0b714531&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:24.573553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.574703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.575163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.575611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.584701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.586704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.607162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6ef5-cdb2-4fa6-a876-dfae17dced37 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.607473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6ef5-cdb2-4fa6-a876-dfae17dced37 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.607709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e6ef5-cdb2-4fa6-a876-dfae17dced37 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.610625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 422/830] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:24.613761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:24.617478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:24.618404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:24.618841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.618841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.618841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.622716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 409/831] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:24.628272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.640607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:24.643899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:24.746859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 423/832] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:24.775329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5cc51-7580-430d-83fe-0ec46dd6d6f1 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.784463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.826593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.826593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.826593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.826593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.827013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:24.827013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:24.827013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:24.841393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 410/833] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:24.848406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:24.865449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:24.872126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:24.915572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8a046-6d6b-44ab-9295-081d6fa225bc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.964965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:24.966596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:24.967325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:24.967789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:24.979931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165ec25-5ad0-43d5-b159-18aa966b2889 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:24.984494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:24.994271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:24.995261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:24.996129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:25.001034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 424/834] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:25.005016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.029988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.031156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.031442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.031717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/71519a4d3c414dd88bad0afdf727a521/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.055107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=71519a4d3c414dd88bad0afdf727a521, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.057273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.077006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 411/835] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:24 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/71519a4d3c414dd88bad0afdf727a521/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:42:25.132012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05e239-2ee6-4914-ad5a-296e08679d44 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.160065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:25.174781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.175691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.176075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.176458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.177371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:25.177788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.179409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.190730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 425/836] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:25.202123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.295500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:25.331458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686952a-a5d7-4534-94b7-129a31fdb405 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.372685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.373748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.374168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.374609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.386935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.388901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f4eb2c18-b87e-4144-a859-79c0ebb66722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:25.408392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:25.409760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:25.410935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:25.410935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:25.410935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:25.410935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:25.412829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 412/837] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:25.419454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.525014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db56d7-388d-446d-8232-2b2fabe2cd9f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.560893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.561513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.561798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.562076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.562800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:25.563110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.565100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaff5f3-cbc2-45db-8dd0-3dd30c43457e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.574778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3540d9a-1d38-4527-9630-b224507eb3e5 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.575254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3540d9a-1d38-4527-9630-b224507eb3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.575672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3540d9a-1d38-4527-9630-b224507eb3e5 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.577439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 413/838] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:25.577609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 426/839] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:25.583731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3540d9a-1d38-4527-9630-b224507eb3e5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.586220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.586585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.586940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.603950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:25.605263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:25.657361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:25.681055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 427/840] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:25.709961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.715539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3540d9a-1d38-4527-9630-b224507eb3e5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.747708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:25.763526 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.766066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.766156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.766422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.782156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.785229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:25.807951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:25.809000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:42:25.810051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:25.816777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 414/841] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:25.817014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.844622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e297ba-7e4f-41c5-8c3f-a1d56c64f008 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.888677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.889597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.889880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.890153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.890875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.892991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:25.906406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:25.907460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:25.908812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:25.912767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 428/842] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:25.914461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.959560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:25.961362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bfaf2-23e0-4496-8487-c532e792dda9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.999445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.001034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.002182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.003036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.004072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:26.004582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.006543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.026093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef7edc-0db4-4a97-b93c-9d04de50d605 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:26.030924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 415/843] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:26.031979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:26.062798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.063469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.063750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.064621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.065365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:26.065800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.067369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.076973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 429/844] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:26.077969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:26.078589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:26.159130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb0d0-fc2a-4610-9c48-50178f97c75a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:26.208624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ab889-bd81-4219-a2ad-7a577119eaef None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:26.210567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:26.211669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.212277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.212586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.212833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.253315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.253997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.254283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.254563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.255279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:26.255587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.257153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.268962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 430/845] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:26.304900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.306411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.353529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:26.419901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 416/846] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:26.426198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:26.535680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986181-eff2-4e12-a24d-16457b19e413 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:26.571322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.572123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.572403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.572676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.583795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.585387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:26.603851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:26.604792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:26.605754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:26.605754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:26.605754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:26.605754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:26.605754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 431/847] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:26.611563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:26.716181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf9cf-de58-40da-8cd5-ee05dd971683 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:26.759748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.761244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.761752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.762217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.763130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:26.763667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.765551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017f0cf-8bc5-423d-969d-f185c5875701 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.778691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:26.785715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 417/848] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:26.791294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:26.812623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:26.817554 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5eb77-b910-4fb9-ba6e-f3782cb3f52f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.817843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5eb77-b910-4fb9-ba6e-f3782cb3f52f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.818124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5eb77-b910-4fb9-ba6e-f3782cb3f52f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.819738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 418/849] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:26.824557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.824845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.825167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.842491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:26.843869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:26.909883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629849d8-c193-48bc-9876-f6fbba517d5b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:26.941019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 419/850] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:26.952078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:26.953140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:26.953597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:26.954110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:26.961921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:26.963520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:26.967837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:26.987559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:26.988517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:26.989456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:26.990577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 432/851] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:26.996180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.083888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae300f7-4f62-49af-a016-1bf06111ac09 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.095666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:27.125298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:27.128500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c368e-a2c3-4429-80be-30c90720ec33 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.140020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.141645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.142838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.143703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.144587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.147016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:27.165556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:27.166549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:27.167400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:27.170220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 420/852] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:27.173113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.174681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.175197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.175701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.176508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:27.176822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.178370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.181047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.197016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 433/853] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:27.199887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.306544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a9369-d0ff-4818-9a29-0b3f7d57e32c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.314822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec68b1-6570-4e53-9522-ada8f995a5ba None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.343061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.343715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.344002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.344316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.345242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=56392bbbf8e449cfbcdddd6a492444bb) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:27.345603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.347014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410b791-3b87-4c1d-b10d-3e285d78f530 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.352141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.361186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 434/854] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/role_assignments?user.id=56392bbbf8e449cfbcdddd6a492444bb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:27.361424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.361424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.361424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.361705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e655d4-731a-475b-998a-272b317e2aa5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.361803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:27.361890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e655d4-731a-475b-998a-272b317e2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.361985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.362082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e655d4-731a-475b-998a-272b317e2aa5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.362082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 435/855] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:27.362235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.362318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.362318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.362318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.367375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:27.367659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 421/856] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:27.375267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.386291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:27.387536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:27.444538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:27.473263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 436/857] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:27.494387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.496988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1c0a5-208a-4d5c-abab-46fcdfbd9458 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.538361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.539353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.539842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.540280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.541185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:27.541692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.543310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.549947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 422/858] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:27.617379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45a376-c78b-4c68-aee8-a607ed40cc22 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.653218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:27.658746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.660270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.661000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.661608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.674663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:27.682698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:27.683719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:27.684822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 437/859] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:27.692889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.816874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65cb7-ef92-49d4-9f76-58dde3023718 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.840160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:27.853760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.854433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.854713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.854985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.855722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:27.856022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.857408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.866979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 423/860] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:27.874028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.987396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bbc46-9d94-42f7-9314-794262906309 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:28.023816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:28.024534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.024821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.025129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.036680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:28.038444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:28.057605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:28.058561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:28.059465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:28.059465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:28.059465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:28.059465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:28.064443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 438/861] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:28.066025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:28.173309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a87b0-fa02-4d76-8401-4a83ede9e5f4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:28.208595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:28.209299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.209577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.209851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.210566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:28.210869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:28.212235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:28.225337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 424/862] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:28.230897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:28.281809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:28.340073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff74cf-5948-4f35-bab3-87ee4767081f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:28.373936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:28.374743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.375028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.375375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.383711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:28.385177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1d11c6d4-d156-44f2-ad55-3d806b2483d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:28.400546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:28.401552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:28.402688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 439/863] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:42:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:28.410823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:28.463672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:28.519498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3eaa-cb00-49a0-88fb-3c65336d5f09 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:28.554819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:28.555490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.555767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.556035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.556859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:28.557194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:28.558624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:28.563268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d04e1-daf0-4f5d-a854-0f9fc64bf8fd None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.563556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d04e1-daf0-4f5d-a854-0f9fc64bf8fd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.563894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d04e1-daf0-4f5d-a854-0f9fc64bf8fd None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.566055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 440/864] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:28.570864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.571150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.571428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.576901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 425/865] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 5 20:42:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:28.585924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:28.590404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:28.591593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:28.673387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 441/866] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:28.692859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:28.696112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef44e2-9dda-4453-8d07-a8d1322f505e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:28.730298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:28.732255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:28.734835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:28.735223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.735500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.736315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.833296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:28.834493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0db1c9-41d0-4f9a-a206-f67a9c83a94c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:28.834679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:28.880766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:28.881819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:28.882314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:28.882787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:28.883692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:28.885775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:28.903910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 442/867] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:28 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:42:28.963408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 426/868] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:28.970687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.088094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:29.105419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dca8f-59fe-4cc1-ac27-133f914e066f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:29.142718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:29.143548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.143876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.144153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.155063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:29.156530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:29.175736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:29.176702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:29.177658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:29.177658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:29.177658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:29.177658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:29.181059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 443/869] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:29.183172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.187259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:29.292747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02001c-a48d-48c1-add2-cc1e16bfc7b6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:29.329389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:29.330075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.330357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.330617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.331337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:29.331639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:29.333047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:29.345709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 427/870] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:29.350923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.461221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c523d-0887-4193-ba14-f6a30be0d386 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:29.497790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:29.498947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.499486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.499953 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.508336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:29.510056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3c013747-fbfb-43e4-8b16-cd266487c051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:29.524668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:29.525659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:29.526612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:29.529291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 444/871] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:29.540952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.604892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:29.646213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1085dd6-5cf8-4775-b597-f539875a34b2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:29.652175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68c800-4981-487f-90e0-5292d35f653f None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.652459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68c800-4981-487f-90e0-5292d35f653f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.652740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68c800-4981-487f-90e0-5292d35f653f None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.654361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 445/872] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:29.659632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111de3-0a6f-4e98-b729-09d23ac958a8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.659907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111de3-0a6f-4e98-b729-09d23ac958a8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.660183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111de3-0a6f-4e98-b729-09d23ac958a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.666277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:29.680395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-48111de3-0a6f-4e98-b729-09d23ac958a8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:29.681111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:29.681722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-48111de3-0a6f-4e98-b729-09d23ac958a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:29.681857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.682035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.682299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.683079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:29.683385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:29.684812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:29.699940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 428/873] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:29.706081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.773851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 446/874] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:29.777890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0974a-9686-4586-a66f-d9a812375247 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.778370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0974a-9686-4586-a66f-d9a812375247 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.778657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0974a-9686-4586-a66f-d9a812375247 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.780102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 447/875] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:29.785657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.785948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.786234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.805759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:29.807037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:29.840074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c01fa8-bb59-4c4f-aa99-f6b59a26084e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:29.865839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:29.879645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:29.880332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.885173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.885303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 448/876] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:29.885387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.885463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.885536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=71519a4d3c414dd88bad0afdf727a521) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:29.885536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:29.885536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:29.904156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 429/877] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:29 2022] GET /identity/v3/role_assignments?user.id=71519a4d3c414dd88bad0afdf727a521&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:29.905299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.960124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:30.006677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16843ef-9b20-4450-9e74-5c1b21c373be None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:30.030248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec5e6-eef8-427a-acdf-51876ff5aa7f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:30.049368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:30.050598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:30.051206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:30.051644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:30.053191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:30.054825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:30.070284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:30.071468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:30.072305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:30.073121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:30.073121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:30.073739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:30.073739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:30.074460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 449/878] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:30.074562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:30.076609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:30.083821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:30.094855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 430/879] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:29 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:30.213269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881f9ab-33ef-4287-8a29-534f4328155b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:30.250331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:30.269374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:30.270276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:30.270686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:30.271113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:30.271949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:30.272391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:30.273930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eee45-aefb-4237-8820-19f4a3c2118f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:30.279187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 450/880] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:30.286164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:30.342418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:30.402345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f04a2-6c4e-4f08-bb59-59e2bbb5346c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:30.439324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:30.439989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:30.440268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:30.440541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:30.441283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:30.441585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:30.442953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2687b4-cda5-40af-82ca-b503508a42ab None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:30.453077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 431/881] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:31.135095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed749b-2a32-4313-be1a-1dc9e1519680 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.135497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed749b-2a32-4313-be1a-1dc9e1519680 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.135675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed749b-2a32-4313-be1a-1dc9e1519680 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.137252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 451/882] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:31.142789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.143083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.143366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.160663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:31.161919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:31.232190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 432/883] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:31.256233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed749b-2a32-4313-be1a-1dc9e1519680 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:31.364345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed749b-2a32-4313-be1a-1dc9e1519680 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:31.401084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:31.402274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.402959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.403488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.404324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:31.406148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:31.419511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:31.420883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:31.422056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:31.425088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 452/884] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:31.433162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:31.478233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:31.535893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a8c01-d547-4bf0-8937-4d6a3a4cb990 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:31.571264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:31.571936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.572214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.572486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.573216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:31.573517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:31.574887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:31.580955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 433/885] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:31.586902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:31.639658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:31.697139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b572e-5c04-45e0-91f3-876a72994e00 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:31.733213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:31.733889 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.734173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.734454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.735163 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:31.735498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:31.737310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:31.742791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 453/886] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:31.748466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:31.852593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e80b59-29f4-48f4-aa49-b60dbf4b5a48 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:31.854978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:31.889102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:31.889761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.890038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.890308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.891087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] RBAC: Adding query filter params (interface=public, service_id=ed7d9d8567e74612b19dce7e792a47d6, region_id=RegionOne) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:31.891394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:31.892871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0e0d3-b7f4-4ae4-93d0-64412a9ba29c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:31.898548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 434/887] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:31 2022] GET /identity/v3/endpoints?service_id=ed7d9d8567e74612b19dce7e792a47d6&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:31.903970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.012532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed56c-65a5-43ee-b1dc-61e63ba1cee9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.027018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:32.053336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec566eb-14a5-4267-8874-fe0802e98037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.054382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec566eb-14a5-4267-8874-fe0802e98037 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.054863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec566eb-14a5-4267-8874-fe0802e98037 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.056629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec566eb-14a5-4267-8874-fe0802e98037 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.057535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec566eb-14a5-4267-8874-fe0802e98037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:32.059098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec566eb-14a5-4267-8874-fe0802e98037 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:32.065801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 454/888] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:31 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:42:32.224874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c69cc-07d8-48a0-bed8-2ea762f1d492 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.225236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c69cc-07d8-48a0-bed8-2ea762f1d492 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.225456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c69cc-07d8-48a0-bed8-2ea762f1d492 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.227069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 435/889] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:32.232539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048040a-734f-4d6b-841b-12a93566c8be None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.233079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048040a-734f-4d6b-841b-12a93566c8be None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.233461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048040a-734f-4d6b-841b-12a93566c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.253916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a048040a-734f-4d6b-841b-12a93566c8be None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:32.255796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a048040a-734f-4d6b-841b-12a93566c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:32.328959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 455/890] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:32.336592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254b11-181e-458e-b627-ee814be48949 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.336592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254b11-181e-458e-b627-ee814be48949 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.336592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76254b11-181e-458e-b627-ee814be48949 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.336859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 436/891] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:32.338263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.338556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.338832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.355245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76254b11-181e-458e-b627-ee814be48949 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.355587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:32.356781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:32.456961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 456/892] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:32.477126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76254b11-181e-458e-b627-ee814be48949 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.477984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.520727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:32.522986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed541f2-831f-41d2-bb27-5c4cec1352fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.523854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed541f2-831f-41d2-bb27-5c4cec1352fb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.524084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed541f2-831f-41d2-bb27-5c4cec1352fb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.524362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed541f2-831f-41d2-bb27-5c4cec1352fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.539243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed541f2-831f-41d2-bb27-5c4cec1352fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3ed541f2-831f-41d2-bb27-5c4cec1352fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:32.550823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:32.551835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:32.552689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 437/893] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:32.558555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe98d-372a-40da-8fc4-5690b73424c0 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.558555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe98d-372a-40da-8fc4-5690b73424c0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.558555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe98d-372a-40da-8fc4-5690b73424c0 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.561009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 438/894] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:32.561960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe98d-372a-40da-8fc4-5690b73424c0 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.594175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:32.594354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3c7f6-2371-4d0f-816c-667d162f2865 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.632149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.632988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.633274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.633552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.634201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:32.635576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e6eb66c5-5b69-4fe8-a461-5ff4c2dc0157 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:32.648143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:32.649184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:32.655027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 457/895] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:32.655878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.655878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.655878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.672142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:32.673857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:32.677872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe98d-372a-40da-8fc4-5690b73424c0 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.714800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.715476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.715763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.716043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.716795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:32.717135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:32.718513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:32.726657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 439/896] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:32.727434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.753709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 458/897] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:32.754822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.792342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:32.843499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:32.855119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd7b3-3656-4724-ae1c-68496d785d6c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.871440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413266d6-850a-481c-a065-62ac62f00c7b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.892826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.893461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.893746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.894022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.894728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:32.895031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:32.896546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:32.905823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 440/898] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:32.905823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.913201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.914035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.914320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.914596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.925201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:32.926647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:32.944457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:32.945619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:32.946544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:32.946544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:32.946544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:32.946544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:32.949905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 459/899] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:32.951057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.013977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be5ec-9668-44eb-838f-beb29b00997c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.051027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.051696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.052385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.052669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.053419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.055462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.061673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:33.070525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 441/900] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:32 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:33.071326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.094593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:33.101157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db089b7-0598-4ff0-a1e1-1f24eedb9003 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.153451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.154395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.154890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.155905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.156774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:33.157234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.159770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.166617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 460/901] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:33.171888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.225533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6b4d6-64d9-4f6b-94ce-67d2700ed801 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.272152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.272963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.273271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.273553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.274278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:33.274581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.276092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.291415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 442/902] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:33.297468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.323646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8d14f-6348-427a-8b7b-c8b17fe4fa23 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.371088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.372056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.372342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.373528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.374340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] RBAC: Adding query filter params (interface=public, service_id=69a52a07d2dc4a41b05b07b107bd073e, region_id=RegionOne) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:33.374656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.376600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.379940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:33.393256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 461/903] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:33 2022] GET /identity/v3/endpoints?service_id=69a52a07d2dc4a41b05b07b107bd073e&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:33.395819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.417720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:33.418653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378164f-c222-40d8-94f7-d3e3964cab49 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.467581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.468772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.469316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.469975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.480365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.483193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:33.503798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:33.504834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:33.505856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:33.506412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592a6c8-fc00-4274-b842-8b196e191ce4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.509813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 443/904] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:42:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:33.520899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.551552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.552611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.553149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.553623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.554521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.556113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.563028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 462/905] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:33 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:42:33.643935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac12be-507c-43ab-ab0d-26e54856aef9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.682621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.683670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.684154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.684682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.685833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:33.686368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.688038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:33.691232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:33.710960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 444/906] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 5 20:42:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:33.716886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:33.808660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:33.843669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb93c5-4477-4841-9139-75d9d05e18f8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:33.881434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f65997-d7ed-4ab7-8fc5-47f0bd763a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:33.882141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f65997-d7ed-4ab7-8fc5-47f0bd763a87 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:33.882430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f65997-d7ed-4ab7-8fc5-47f0bd763a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:33.882709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f65997-d7ed-4ab7-8fc5-47f0bd763a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:33.956184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f65997-d7ed-4ab7-8fc5-47f0bd763a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:33.957619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f65997-d7ed-4ab7-8fc5-47f0bd763a87 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.035934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:34.073454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 463/907] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:34.078498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.190770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a998a-cd97-4998-a82a-9ba54e273403 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.226696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408b989-7533-425c-901b-9424de1da9db None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.226980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408b989-7533-425c-901b-9424de1da9db None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.227173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408b989-7533-425c-901b-9424de1da9db None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.228662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 464/908] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:34.230160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.230959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.231238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.231509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.234569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.235076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.236000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.243986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.245503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.261216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:34.262862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:34.278139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:34.279242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:34.280227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:34.280227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:34.280227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:34.280227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:34.280227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 445/909] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:34.287168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.337954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:34.360962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 465/910] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:34.379185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.406648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00a0f-d4af-4a3b-ae95-3a42b7016b27 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.443645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.444661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.445223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.445720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.446660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:34.447177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.448753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.465844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 446/911] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:34.466966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.508009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47899fdd-89e4-45df-81f9-177f7728f8e8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.509454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:34.554730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.555811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.556101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.556382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.557068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.558851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:34.576676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:34.577880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:34.583963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 466/912] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:34.584823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.587231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f17464-f38b-462a-9896-4f5f3e4b2f3c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.590084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:34.627467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.628802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.629416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.629942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.639400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.641002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:34.661410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:34.662389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:34.663595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:34.665013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 447/913] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:34.668457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.710508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afdab-196e-4a71-b351-6a63feabe54a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.751379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.752187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.752469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.752745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.753607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:34.753826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.755250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.768535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 467/914] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:34.769669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.807771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:34.808195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145f1c-b66c-4d24-b9c1-6749aa4a2e02 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.859716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.860755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.861228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.861683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.863028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:34.863913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.865848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.887940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 448/915] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:34.889487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.893697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd0b06-f8e5-49aa-8d9f-168a6cbbe8bc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.923301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:34.933637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.934304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.934584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.934859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.935561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:34.935864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.937884 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.943139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 468/916] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:34.948564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:35.025111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3141e-39b4-4355-87da-8ef3868948af None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:35.056920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:35.066809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e462770-e33f-41e8-a0e1-04af1e37d563 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:35.074936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:35.076339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.076794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.077260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.078704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] RBAC: Adding query filter params (role.id=3cd9b3e82eae432693c45155ae099ce7, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=71519a4d3c414dd88bad0afdf727a521) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:35.079285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:35.081688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b91f8-931a-4899-8526-43d7792f092b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:35.097640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 449/917] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/role_assignments?user.id=71519a4d3c414dd88bad0afdf727a521&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=3cd9b3e82eae432693c45155ae099ce7 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:35.124956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970bce1-30af-4f50-b455-6b2941dd380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:35.124956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970bce1-30af-4f50-b455-6b2941dd380b None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.124956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970bce1-30af-4f50-b455-6b2941dd380b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.124956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970bce1-30af-4f50-b455-6b2941dd380b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.125413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970bce1-30af-4f50-b455-6b2941dd380b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:35.125413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970bce1-30af-4f50-b455-6b2941dd380b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:35.150920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 469/918] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:35.244462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b020fc-5e31-48a0-ad32-5e2c0fffffd1 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.244824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b020fc-5e31-48a0-ad32-5e2c0fffffd1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.245197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b020fc-5e31-48a0-ad32-5e2c0fffffd1 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.247449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 450/919] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:35.254444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.254774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.255000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.275259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:35.276395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:35.358852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 470/920] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:35.383229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b020fc-5e31-48a0-ad32-5e2c0fffffd1 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:35.487700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:35.502367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b020fc-5e31-48a0-ad32-5e2c0fffffd1 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:35.538708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:35.539895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.540396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.540892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.541780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:35.543355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:35.556361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:35.557528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:35.558467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:35.561492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 451/921] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:35.570059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:35.654895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:35.682016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58620e-027e-494e-afa4-c2c2afc1794f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:35.717992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:35.718668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.718951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.719228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.720507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:35.721072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:35.722600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cd8eb-97c5-4af5-949f-904f184796a1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:35.727882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 471/922] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:35.733368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:35.752262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2512-e52c-452f-9ab1-03125472bdaa None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.752543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2512-e52c-452f-9ab1-03125472bdaa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.752817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f2512-e52c-452f-9ab1-03125472bdaa None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.754651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 472/923] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:35.767556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.767845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.768127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.791611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:35.792854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:35.880295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 473/924] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:35.888076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafee2-219a-4d97-97e9-073484c16b43 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:35.903269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:35.936611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:35.937984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:35.938750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:35.939247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:35.940864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:35.941447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:35.943977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:35.956681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 452/925] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:35.958663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:35.985641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:35.994855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:36.042208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a0f9a-0864-456e-a69f-1aa80331a424 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.088950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.090082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.090371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.090652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.091308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.093340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.104086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4fdc-c7ef-4bba-b19e-aeac5a957afc None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:36.112865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:36.114127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:42:36.115094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:36.119190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 474/926] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 5 20:42:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:36.126309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:36.160864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.161616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.161906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.162186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.163235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] RBAC: Adding query filter params (interface=public, service_id=e4746b30cf4949e097e64f905cc8229c, region_id=RegionOne) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:36.163552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.164950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.175715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 453/927] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:35 2022] GET /identity/v3/endpoints?service_id=e4746b30cf4949e097e64f905cc8229c&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:36.177038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:36.248259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88832469-ce75-455d-91b4-4f72f79ea660 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.274000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:36.299927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.301238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.301538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.301824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.302527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06876-3890-43c3-abde-e6a83917d0e7 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.303089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:36.303617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.307407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.308830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:36.320332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 475/928] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:36.322251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:36.354856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.355524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.355802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.356071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.356752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.358518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.367156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 454/929] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:36 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:42:36.459822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b1cea-a94a-4816-8db7-5b6e148d9ab8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.499339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.500306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.500750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.501999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.502757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:36.503072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.504473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca8edd-9d94-4fce-be69-e785c04cc68d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.522203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 476/930] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:36.530675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:36.651192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d791-523a-488d-ae1f-ea8554fb3aa0 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.691725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59bc2b-61fe-44dc-8cfc-c8edbaad7d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.692457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59bc2b-61fe-44dc-8cfc-c8edbaad7d5d None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.692756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59bc2b-61fe-44dc-8cfc-c8edbaad7d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.693089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59bc2b-61fe-44dc-8cfc-c8edbaad7d5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.693884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59bc2b-61fe-44dc-8cfc-c8edbaad7d5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.695298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59bc2b-61fe-44dc-8cfc-c8edbaad7d5d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.730424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:36.755158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 455/931] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:42:37.367523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436add-1e3e-4501-94d9-9a9a9c652a4d None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.368074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436add-1e3e-4501-94d9-9a9a9c652a4d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.368074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436add-1e3e-4501-94d9-9a9a9c652a4d None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.369715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 477/932] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:37.374823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9ab06-09de-478a-b382-eec3fd6152fc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.375114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9ab06-09de-478a-b382-eec3fd6152fc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.375390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9ab06-09de-478a-b382-eec3fd6152fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.392893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-54c9ab06-09de-478a-b382-eec3fd6152fc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:37.394094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-54c9ab06-09de-478a-b382-eec3fd6152fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:37.473473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a631-b1da-4948-a65a-0a67ac315521 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.473755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 456/933] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:37.473866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a631-b1da-4948-a65a-0a67ac315521 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.474013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a631-b1da-4948-a65a-0a67ac315521 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.475573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 478/934] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:37.480750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.481310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.481792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.498356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a631-b1da-4948-a65a-0a67ac315521 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:37.499429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:37.500890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:37.576414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 457/935] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:37.581168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:37.595404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:37.628386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a631-b1da-4948-a65a-0a67ac315521 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:37.666327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:37.667813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.668358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.669050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.669718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:37.686525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:37.695837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:37.696817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:37.697727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:37.706054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 479/936] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 5 20:42:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:37.707174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:37.729950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70223af-6d3c-43c1-b32b-84d736de676b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:37.780178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:37.780178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.780178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.780178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.781248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:37.783260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:37.784955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING keystone.server.flask.common [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 20:42:37.810088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.sql.core [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 20:42:37.810088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 20:42:37.810088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [parameters: {'id': 'eb75fb349c0c4e4b8a8dba02a9703731', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 20:42:37.810088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80151) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb75fb349c0c4e4b8a8dba02a9703731.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb75fb349c0c4e4b8a8dba02a9703731. Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:42:37.822315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result.read() Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 20:42:37.823145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application yield resource Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise self.value Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application session.commit() Jul 05 20:42:37.824116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.session.flush() Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application compat.raise_( Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 20:42:37.825585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 20:42:37.826515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application result.read() Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:42:37.827321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [parameters: {'id': 'eb75fb349c0c4e4b8a8dba02a9703731', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:37.828743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:37.830788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb75fb349c0c4e4b8a8dba02a9703731. Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 458/937] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jul 5 20:42:37 2022] POST /identity/v3/projects => generated 262 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:37.832918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:37.836750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef32f3-282f-4ef7-b877-e31afc1f2d57 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:37.869486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:37.886669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:37.887474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:37.888020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:37.888304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:37.889564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:37.889947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:37.891865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:37.904965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 480/938] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:42:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:37.910592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:37.962719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11be807-8647-4815-b74e-70d8740c4cc6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:37.978301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:38.002180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.002966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.003245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.003518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.011086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.012747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:38.028664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:38.029715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:38.031272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 459/939] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:38.035248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1633354-9395-475f-806e-90c7acbb72ae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.036496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.070920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.071861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.072142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.072414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.084232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.085873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:38.105036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:38.106208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:38.107303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:38.107303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:38.107303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:38.107303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:38.111261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 481/940] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:38.112120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.150332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:38.150881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05f05a-93bc-4b4c-9ae2-01d3bbc99450 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.189724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.190837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.191400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.191848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.192779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:38.193308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.194923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.223157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372fe61-0b91-48fd-a51e-63448e98f7cd None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.223498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 460/941] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:38.263426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.264146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.264431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.264756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.265530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:38.265834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.267975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.281872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 482/942] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:38.288717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.326523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:38.403651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c4fbe-0676-42e3-a002-122264ee9f63 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.441064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.442285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.442770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.443236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.451041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.452723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:38.468866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:38.470009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:38.470980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:38.472793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 461/943] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:38.478762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.579767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:38.586032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1f23-3963-409b-be91-458ee9f2d8f3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.621924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.622601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.622881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.623159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.624051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:38.624360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.625954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8ace3-a39c-4c79-b3ba-275706c77f10 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.649884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.653896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 483/944] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:38.683192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3383-b537-4a5a-a733-35a8e02dc655 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.683867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3383-b537-4a5a-a733-35a8e02dc655 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.684344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3383-b537-4a5a-a733-35a8e02dc655 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.686273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 484/945] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:38.692470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.692761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.693096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.710206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:38.711406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:38.783265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:38.792392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 485/946] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:38.796769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b494d67-e873-42cf-8ef2-617c103bc305 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.817443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.841985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.843532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.844166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.844785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.860318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.862480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:38.886126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:38.887099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:38.888021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:38.888021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:38.888021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:38.888021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:38.895772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 462/947] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:38.896737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.916285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:38.935000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3cca1-372b-483c-accf-caa909c72808 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.972237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.973156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.973489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.973771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.974435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.975821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:38.988532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:38.989619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:38.990497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:38.995034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 486/948] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:38.995972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.028504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42e994-9b2b-4852-835f-57730b86ac4c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.065249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.065909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.066804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.067080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.067800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:39.068101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.069505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbfa9a-de82-4441-b791-d152108eaead None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.084683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 463/949] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:39.084683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152913c7-5517-4cea-8a70-f155a561d1a4 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.084683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152913c7-5517-4cea-8a70-f155a561d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.084683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152913c7-5517-4cea-8a70-f155a561d1a4 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.085287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 464/950] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:39.090502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.090958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.091243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.097895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.109334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:39.111468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:39.117232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0ae45-d5b7-4af5-87ad-64bd2ef71643 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.153600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.154269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.154552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.154839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.155803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:39.155803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.157295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.167039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 487/951] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:39.167039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.179987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.192970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 465/952] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:39.192970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.278120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b953-1b34-4966-aee2-0cb962b9a136 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.312334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e7f57-e1f1-4ee3-9560-b2866af06d4a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.315523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.316321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.316605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.316879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.323582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.325058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:39.339815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:39.340759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:39.341722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 488/953] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:39.342400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.356793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.358572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.358865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.359145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.359848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:39.361039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.363591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.364963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.373916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 466/954] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:39.376142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.428621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.461507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f198da0-2ddf-440b-9bc2-f5d67278a737 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.487611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ac6b-4b75-46be-a579-5e32c9e0f32a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.501826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.502760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.502943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.503179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] PATH_INFO: `/v3/services/compute` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.503825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.505224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:39.518538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:39.519699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:39.520629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 489/955] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:39.521535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.528439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.529200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.529483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.529756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.530540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:39.530844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.532773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.546047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 467/956] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:39.547392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.612325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.633079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3b395-aebe-493b-8bdd-4ad39dd303ad None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.656102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f19ab-e2ef-469c-adf2-750619f16b3a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.674344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.675012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.675298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.675576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.676317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.677720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.682582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.696168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.696844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.697163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.697458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.698095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:39.698588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.698707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 490/957] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:39.699282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.710599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.719825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 468/958] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:39.725936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:39.838420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052812-d1c2-4fb0-baa0-9d00ceee6ef7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.873291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928f1ef-fac5-4cc2-95d3-ccd6302abc56 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:39.883883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9dd0-2c89-4a06-93dc-8b01208a2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.884893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9dd0-2c89-4a06-93dc-8b01208a2fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.885274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9dd0-2c89-4a06-93dc-8b01208a2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.885952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9dd0-2c89-4a06-93dc-8b01208a2fb7 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/71519a4d3c414dd88bad0afdf727a521/roles/3cd9b3e82eae432693c45155ae099ce7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.888153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb9dd0-2c89-4a06-93dc-8b01208a2fb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=71519a4d3c414dd88bad0afdf727a521, role_id=3cd9b3e82eae432693c45155ae099ce7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.889720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb9dd0-2c89-4a06-93dc-8b01208a2fb7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.903806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:39.909158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 491/959] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:39 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/71519a4d3c414dd88bad0afdf727a521/roles/3cd9b3e82eae432693c45155ae099ce7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:42:39.921166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:39.921962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:39.922186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:39.922489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:39.923203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:39.923544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:39.925025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95aad75-3187-4909-85ca-4c157e70593a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:39.930686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 469/960] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:40.506905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f64bb-fd4b-43da-94ac-3d16dfe286a6 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:40.507431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f64bb-fd4b-43da-94ac-3d16dfe286a6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:40.507431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f64bb-fd4b-43da-94ac-3d16dfe286a6 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:40.508973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 492/961] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:40.515085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:40.515447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:40.515652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:40.535255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:40.536474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:40.619204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 470/962] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:40.645304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f64bb-fd4b-43da-94ac-3d16dfe286a6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:40.703594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:40.759091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f64bb-fd4b-43da-94ac-3d16dfe286a6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:40.796142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:40.796809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:40.797120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:40.797392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:40.798141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:40.799562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:40.800865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING keystone.server.flask.common [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 20:42:40.815191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.sql.core [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 20:42:40.815191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 20:42:40.815191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [parameters: {'user_id': '4393904eac9341d99d7f0539fed0b970', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 20:42:40.815191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80152) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application result.read() Jul 05 20:42:40.832573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:42:40.833565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application yield resource Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise self.value Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application session.commit() Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 20:42:40.834578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.session.flush() Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application compat.raise_( Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 20:42:40.835506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:42:40.836439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application result.read() Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:42:40.838685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [parameters: {'user_id': '4393904eac9341d99d7f0539fed0b970', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:40.840790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 20:42:40.842824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:40.849919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 493/963] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 5 20:42:40 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:40.854250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:40.957919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea800c7-bc6f-4f5c-95f3-8b69bc82f7db None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:40.979259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:41.000575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:41.001998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:41.002503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:41.002778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:41.011062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:41.012442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-29f92e6f-273f-4ada-857d-dd051d0f28a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:41.028003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:41.029023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:41.029999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 471/964] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:41.038150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:41.147503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3be7c3-9d1d-41a2-9ce1-334ce8037f58 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:41.163130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:41.192185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:41.193329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:41.193842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:41.194353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:41.195404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:41.195939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:41.197870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22647974-713b-4c00-aeeb-213dc44c3045 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:41.238876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 494/965] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 5 20:42:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:41.944078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e787471-4cf1-41ba-9c84-f1f5bd6dac16 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:41.944401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e787471-4cf1-41ba-9c84-f1f5bd6dac16 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:41.944633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e787471-4cf1-41ba-9c84-f1f5bd6dac16 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:41.946083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 472/966] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:41.951194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357245-6459-4908-9f4a-87c6ff62f53c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:41.951629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357245-6459-4908-9f4a-87c6ff62f53c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:41.951826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357245-6459-4908-9f4a-87c6ff62f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:41.969596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-95357245-6459-4908-9f4a-87c6ff62f53c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:41.971250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-95357245-6459-4908-9f4a-87c6ff62f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:42.038546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 495/967] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:42.061292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e787471-4cf1-41ba-9c84-f1f5bd6dac16 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.135949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0660ed-94f7-4d1b-8acd-f5cc0865e2d6 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.136242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0660ed-94f7-4d1b-8acd-f5cc0865e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.136521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0660ed-94f7-4d1b-8acd-f5cc0865e2d6 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.137941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 496/968] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:42.139217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76bb50-f19c-49d5-b342-1c3b8e34cb0b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.139506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76bb50-f19c-49d5-b342-1c3b8e34cb0b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.139786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76bb50-f19c-49d5-b342-1c3b8e34cb0b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.141040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 497/969] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:42.143637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.143925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.144202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.164572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:42.166024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:42.175532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e787471-4cf1-41ba-9c84-f1f5bd6dac16 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.212140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.212969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.213256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.213533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.214176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.215574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b10b55ea-434c-4854-95af-a17bbcb2a83a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:42.229157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:42.230247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:42.231126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 473/970] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:42.231990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.231990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.232124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.240813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 498/971] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:42.241692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.248350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:42.249555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:42.270452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:42.285636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:42.321170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 474/972] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:42.321753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.353925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2c01-702d-4394-9e4f-f6995a5b2926 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.390628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.391358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.391639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.391916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.392623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:42.392964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.394339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.399370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 499/973] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:42.400051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.427847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42235d-7ed6-4a89-bce7-a680053136a4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.462607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.463407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.463686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.463960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.474344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:42.482395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:42.483393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 475/974] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:42.484474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.497342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:42.508212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17946d-732b-49e5-b849-c96eb4509ea5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.518626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:42.547121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.548414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.548698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.548995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.549716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.551094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.564792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 500/975] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:42 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:42.565482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.601799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375bdaa-5136-4824-ac91-730e2faf774c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.650133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.650939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.651218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.651600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.652318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:42.652647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.654064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.665009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 476/976] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:42.665964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.685246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29a107-50f8-4dc4-9a3e-17765e9f70e1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.722770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.723445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.723726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.723997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.724737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:42.726160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.726438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.739416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 501/977] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:42.745140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.765307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:42.769837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:42.781199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404d0e7-667a-454d-902e-ca98de097feb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.818862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.820026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.820348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.820589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.825298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] RBAC: Adding query filter params (interface=admin, service_id=e4746b30cf4949e097e64f905cc8229c, region_id=RegionOne) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:42.825632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.827039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.834047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 477/978] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/endpoints?service_id=e4746b30cf4949e097e64f905cc8229c&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:42.839675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.868755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b8e16-8b89-446f-84e2-2744ed9d7951 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.906545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.907699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.908196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.908674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.920455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.921950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:42.940695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:42.941688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:42.942648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:42.942648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:42.942648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:42.942648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:42.942648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 502/979] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:42.947477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:42.953606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d14a-2c57-4883-bd3c-c6eba69933ab None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:42.991917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:42.992582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:42.992861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:42.993162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:42.993834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:42.995197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:43.001753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 478/980] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:42:43.024373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:43.067606 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ca83c-6be6-4072-88ed-3459108cf024 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:43.106179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:43.106873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:43.107158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:43.107437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:43.108172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:43.108482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:43.109916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:43.130301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 503/981] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:43.131524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:43.154461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:43.245761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa58028-35cc-4067-8b1c-e8f3b4d62e93 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:43.280878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:43.282641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:43.283131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:43.283698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:43.292017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:43.293718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:43.308265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:43.309271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:42:43.310232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:43.310799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 479/982] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:43.316553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:43.425997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809be3c2-8185-4fb9-8069-15c056fa5160 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:43.454392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:43.463905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:43.464576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:43.464856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:43.465156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:43.465987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:43.466291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:43.467703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:43.486796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 504/983] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 5 20:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:43.492113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:43.573306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:43.596940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e8ac-4950-4ccb-8c3b-05435bd68ace None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:43.631208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:43.631854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:43.632138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:43.632413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:43.701243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:43.702692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:43.794436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:43.818451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 480/984] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:43.823985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:43.924842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cd333-e145-4b9d-a16f-19cf43fc04e6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:43.959306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:43.960125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:43.960303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:43.960576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:43.970617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:43.972057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:43.989338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:43.990243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:43.995941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:43.995941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:43.995941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:43.995941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:43.995941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 505/985] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:43.996225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:44.096688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c1acf-d615-4a6d-92ab-23d59c945716 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:44.131636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:44.132393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.132563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.132837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.133635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:44.133943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:44.135369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:44.152561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 481/986] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:44.154408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:44.190655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:44.256474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde8ab-095c-41a1-8b9d-ec4b11daefda None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:44.292292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:44.293111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.293397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.293672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.300701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:44.302180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:44.316252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:44.317475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:44.323044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 506/987] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:44.325115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:44.368577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:44.434672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442765-53ce-49ba-a762-def91e1e38bb None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:44.470974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:44.471647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.471934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.472211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.473026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:44.473339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:44.474779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfe684-2ee4-4a5f-a256-90261ad14bc3 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:44.492230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 482/988] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:44.494242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:44.595182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:44.602622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fbca5-be4a-489c-875f-d13ffdfd08d0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:44.635908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:44.636565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.636847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.637148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.638002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] RBAC: Adding query filter params (role.id=3cd9b3e82eae432693c45155ae099ce7, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=71519a4d3c414dd88bad0afdf727a521) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:44.638316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:44.639735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:44.641784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d70b-8b49-4785-bf24-2c302ae317d2 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.642150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d70b-8b49-4785-bf24-2c302ae317d2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.642429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792d70b-8b49-4785-bf24-2c302ae317d2 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.643794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 483/989] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:44.648741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 507/990] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:44 2022] GET /identity/v3/role_assignments?user.id=71519a4d3c414dd88bad0afdf727a521&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=3cd9b3e82eae432693c45155ae099ce7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:44.648872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.649156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.649430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.670002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:44.671219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:44.746892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 484/991] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:44.771952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:44.886319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dd2f-875c-4e60-a325-4c88096a084e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:44.920324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:44.921148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:44.921431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:44.921701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:44.922366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:44.923740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:44.935380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:44.936391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:44.937312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:44.939173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 508/992] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:44.943271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:44.971554 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:45.044515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa2391-b498-4c0c-9b37-b55873b46396 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.081891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.082556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.082832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.083101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.083795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:45.084093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.085575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9ed0e-c037-41fe-aaaa-715eebff8590 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.093031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 485/993] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:45.096684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.108968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb725f-fa3c-4b95-a95a-0cfee1deb206 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.108968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb725f-fa3c-4b95-a95a-0cfee1deb206 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.109222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb725f-fa3c-4b95-a95a-0cfee1deb206 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.111191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 486/994] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:45.116474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.116761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.117076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.127372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:45.134423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:45.135613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:45.205972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 487/995] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:45.214494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9c6de-e4cd-49f8-a0bd-3aa0281be3e4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.229573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.250473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.251136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.251451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.251699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.252531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:45.252824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.253708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:45.254243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.261101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 509/996] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:45.267852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.338972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846341a7-e1f5-4f75-8298-905a6b8d0f85 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.360115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:45.374500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7a2a-3dbb-44ed-9ea8-f4dd533e2212 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.377091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.378673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.378953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.379221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.379871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.381262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:45.397575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:45.398637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:45.404895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 488/997] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 5 20:42:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:45.406103 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.411221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.411891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.412179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.412457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.413553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] RBAC: Adding query filter params (interface=public, service_id=d115b2aa12b747118a104c5dbc68b007, region_id=RegionOne) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:45.413870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.415256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.421094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 510/998] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:45 2022] GET /identity/v3/endpoints?service_id=d115b2aa12b747118a104c5dbc68b007&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:45.426969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.498615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:45.515658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8374-0471-439f-9214-5f108979ecf8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.538506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2093-0390-430a-9641-1846ef5c8be7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.550959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.551626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.551917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.552192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.552898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:45.553238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.554618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.564385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 489/999] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:45.566310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.581888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.582644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.583000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.583352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.584101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.585499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.592154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 511/1000] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:45 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:42:45.678535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5fce4-0ab1-4248-be04-539439946d78 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.714714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.715488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.715836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.716180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.716990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:45.717365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.718815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c78e2f-6465-4014-9027-45391054c096 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.730201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 490/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 5 20:42:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:45.731264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:45.752864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:45.848068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb56bf5-855d-4948-b4db-6e02ebd90bcb None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:45.883169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e519f1b-2ea2-4e94-81d6-ab805f7f0d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:45.883835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519f1b-2ea2-4e94-81d6-ab805f7f0d3b None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:45.884124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519f1b-2ea2-4e94-81d6-ab805f7f0d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:45.884401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519f1b-2ea2-4e94-81d6-ab805f7f0d3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:45.885185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e519f1b-2ea2-4e94-81d6-ab805f7f0d3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:45.886566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e519f1b-2ea2-4e94-81d6-ab805f7f0d3b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:45.902004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 512/1002] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:42:46.784600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3800-aebc-45a1-a7cd-4845b1ce22b6 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:46.785110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3800-aebc-45a1-a7cd-4845b1ce22b6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:46.785221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3800-aebc-45a1-a7cd-4845b1ce22b6 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:46.786749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 491/1003] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:46.791872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:46.792251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:46.792418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:46.809345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:46.810523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:46.888439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 513/1004] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:46.911033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3800-aebc-45a1-a7cd-4845b1ce22b6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:46.928439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:47.014576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3800-aebc-45a1-a7cd-4845b1ce22b6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:47.054470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:47.055263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.055541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.055812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] PATH_INFO: `/v3/services/image` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.056458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:47.057853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:47.069935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:47.070945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:47.071807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:47.073617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 492/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 5 20:42:46 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:47.077404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:47.079633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:47.188597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad53d3-e9c0-4b76-96a0-dfac4f7f3865 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:47.223099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:47.223848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.224128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.224399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.225125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:47.225495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:47.227247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32f98d-cc2a-4aea-a214-82317a26f7c4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:47.236488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 514/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:47.241064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:47.324029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:47.347902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542fa27-f27e-44a0-b76d-ac1ad9dd8e5f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:47.380989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:47.381659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.381936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.382201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.382895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] RBAC: Adding query filter params (type=image) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:47.383194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:47.384557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3357d-c181-475b-af76-8c6dc0eb3e2f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:47.389332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 493/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:47.699440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5261c5e-c269-430f-81e9-61eaa3d46b49 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.699740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5261c5e-c269-430f-81e9-61eaa3d46b49 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.699943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5261c5e-c269-430f-81e9-61eaa3d46b49 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.701450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 515/1008] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:47.706778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95481411-adfa-42eb-b405-e4a06d49169f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.707067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95481411-adfa-42eb-b405-e4a06d49169f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.707342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95481411-adfa-42eb-b405-e4a06d49169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.724472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-95481411-adfa-42eb-b405-e4a06d49169f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:47.725679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-95481411-adfa-42eb-b405-e4a06d49169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:47.802225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 494/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:47.824621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5261c5e-c269-430f-81e9-61eaa3d46b49 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:47.895776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:47.932482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5261c5e-c269-430f-81e9-61eaa3d46b49 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:47.967197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78dd38-e4ce-4b2f-8fd4-b3a28fffd655 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.967469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78dd38-e4ce-4b2f-8fd4-b3a28fffd655 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.967682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78dd38-e4ce-4b2f-8fd4-b3a28fffd655 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.967784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:47.968484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.968771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.969266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.969378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 495/1010] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:47.969771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:47.971129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:47.976194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:47.976481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:47.976756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:47.983261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:47.984285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:47.986282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 516/1011] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:47.990759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:47.998351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:47.999548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:48.070991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 496/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:48.094460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:48.097607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:48.102780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db1334-46c8-4b29-aa6f-85d68e1cfd1d None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:48.134390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:48.141308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:48.141946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:48.142230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:48.142542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:48.143241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:48.143545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:48.144911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:48.150116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 517/1013] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:48.155287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:48.207629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59847ac9-07c6-47f0-918e-1c2723888e2a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:48.245436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:48.246148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:48.246429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:48.246704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:48.247915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:48.249528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:48.252962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 497/1014] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:48.257495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:48.262944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a54e21-ed6e-4fca-910d-9c1aa8a484c7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:48.301560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:48.302230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:48.302520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:48.302803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:48.303507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:48.303817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:48.305216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:48.310246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 518/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 5 20:42:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:48.316633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:48.334605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:48.369514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3eee2-640f-4058-9440-ae8867b08e63 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:48.376859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:48.409063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04072ff-f7f5-4cb9-9447-08d4ad8a35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:48.409726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04072ff-f7f5-4cb9-9447-08d4ad8a35a7 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:48.410004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04072ff-f7f5-4cb9-9447-08d4ad8a35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:48.410275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04072ff-f7f5-4cb9-9447-08d4ad8a35a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:48.411028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04072ff-f7f5-4cb9-9447-08d4ad8a35a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:48.412567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04072ff-f7f5-4cb9-9447-08d4ad8a35a7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:48.424995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f36797-8f85-4ec6-96aa-a94de0525e0a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:48.440134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 498/1016] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:48 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:42:48.468079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb0a95-d69d-4dd4-aedf-6d3185789b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:48.468771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb0a95-d69d-4dd4-aedf-6d3185789b7a None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:48.469652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb0a95-d69d-4dd4-aedf-6d3185789b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:48.469932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb0a95-d69d-4dd4-aedf-6d3185789b7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:48.470751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb0a95-d69d-4dd4-aedf-6d3185789b7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:48.472173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb0a95-d69d-4dd4-aedf-6d3185789b7a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:48.501059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 519/1017] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:42:49.462551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ca121-b1a3-4e16-9b4a-c2ed023adbcb None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:49.463083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ca121-b1a3-4e16-9b4a-c2ed023adbcb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:49.463083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ca121-b1a3-4e16-9b4a-c2ed023adbcb None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:49.464504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 499/1018] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:49.469673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea9a6-e263-4ca0-b08e-8f87a3640a5c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:49.470061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea9a6-e263-4ca0-b08e-8f87a3640a5c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:49.470246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea9a6-e263-4ca0-b08e-8f87a3640a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:49.489154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b4dea9a6-e263-4ca0-b08e-8f87a3640a5c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:49.490342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b4dea9a6-e263-4ca0-b08e-8f87a3640a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:49.563827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 520/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:49.586775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ca121-b1a3-4e16-9b4a-c2ed023adbcb None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:49.694165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ca121-b1a3-4e16-9b4a-c2ed023adbcb None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:49.717919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:49.731990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f956bf4-d7ac-4eb2-ab44-2d10c1c598b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:49.732670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f956bf4-d7ac-4eb2-ab44-2d10c1c598b7 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:49.732971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f956bf4-d7ac-4eb2-ab44-2d10c1c598b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:49.733252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f956bf4-d7ac-4eb2-ab44-2d10c1c598b7 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:49.733991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f956bf4-d7ac-4eb2-ab44-2d10c1c598b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:49.736113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f956bf4-d7ac-4eb2-ab44-2d10c1c598b7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:49.760075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 500/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:42:49 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:50.553318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b25c-4e66-428a-a374-edd06cffd39a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:50.553847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b25c-4e66-428a-a374-edd06cffd39a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:50.553847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68b25c-4e66-428a-a374-edd06cffd39a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:50.555290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 521/1021] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:50.560465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507e5e-e1f1-48d2-9f68-02fc681893b1 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:50.560851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507e5e-e1f1-48d2-9f68-02fc681893b1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:50.561067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507e5e-e1f1-48d2-9f68-02fc681893b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:50.578475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-07507e5e-e1f1-48d2-9f68-02fc681893b1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:50.579658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-07507e5e-e1f1-48d2-9f68-02fc681893b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:50.658219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 501/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:50.683388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b25c-4e66-428a-a374-edd06cffd39a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:50.709290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e0af-25ee-47ab-8ce7-39b7f6675239 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:50.709645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e0af-25ee-47ab-8ce7-39b7f6675239 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:50.709846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2e0af-25ee-47ab-8ce7-39b7f6675239 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:50.711216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 502/1023] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:50.716699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:50.717006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:50.717684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:50.729796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:50.739977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:50.741409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:50.804780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68b25c-4e66-428a-a374-edd06cffd39a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:50.820235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 503/1024] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:50.843727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:50.844684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:50.844991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:50.845275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:50.845541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:50.846656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:50.848097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:50.849772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 522/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:50.855171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:50.889100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:50.958533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542ac8-1441-4840-9ab0-6b6fc118d69e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:50.965195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c437c20-f273-45fc-88c9-6032deb31973 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:50.975961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:50.994661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:50.995479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:50.995761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:50.996221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.004690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:51.005254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.005541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.005822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.006549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:51.007659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:51.007953 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:51.016135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:51.017196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:51.018044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:51.022193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 504/1026] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 5 20:42:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:51.023446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.032792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 523/1027] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:42:50 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:42:51.138019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:51.143040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dcbfa-b974-4d59-adf0-21ca5ae4706d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:51.183396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:51.184078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.184363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.184640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.185426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:51.185741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:51.187119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:51.197192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 505/1028] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:51.202925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.310063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af74e24-0509-4a09-9c62-1d4feed5af82 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:51.344725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:51.345561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.345847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.346126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.357178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:51.358644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:51.376557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:51.377547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:51.378481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:51.378481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:51.378481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:51.378481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:51.379176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 524/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:51.383820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.492288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde5105-6212-4da9-bd1f-208b2a4fc399 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:51.526810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:51.527478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.527768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.528040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.528762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:51.529097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:51.530475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:51.547424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 506/1030] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:51.548740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.570105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:51.660274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244fd08-5045-4892-8da3-abc89acc8826 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:51.697529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:51.698330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.698612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.698885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.707997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:51.709478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b69aee7a-31d3-4c6f-a939-fb7d9e16579b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:51.724393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:51.725663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:51.726711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 525/1031] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:51.733096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.754970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:51.850279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2014dea-aee9-4933-8d84-c0e49b8531f2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:51.854229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2051042-3ccc-4c72-982d-b3ad70190e57 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.854515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2051042-3ccc-4c72-982d-b3ad70190e57 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.854849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2051042-3ccc-4c72-982d-b3ad70190e57 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.856964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 526/1032] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:51.861511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.861801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.862080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.878811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:51.879992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:51.888033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:51.888699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:51.889003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:51.889285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:51.890089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:51.890390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:51.892338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:51.915508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 507/1033] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:51.916466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.953150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 527/1034] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:51.977050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:51.985183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.004852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.029033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a0a1-10e6-4719-aff0-22a8e9890f80 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.068514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.069215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.069501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.069777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.084293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e809e8-bec9-4456-a5ad-2b86bcc8624a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.127064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.128216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.128709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.129199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] PATH_INFO: `/v3/services/image` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.129855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.131217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:52.143409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:52.144436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:52.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 528/1035] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:52.148790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.150286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.150513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.229445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.241777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.265601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84032b1-a89f-483b-a6c9-f2260dffbeba None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.268651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 508/1036] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:52.274055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.305029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.305694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.305974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.306412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.306981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] RBAC: Adding query filter params (name=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:52.307239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.308690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.315294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 529/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:52.320577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.383635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c454710-8236-4971-b03d-19d4a3974c37 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.423379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.424713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.425227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.425505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.437368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.438282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a9e9-10df-4800-ba13-402be4c5e576 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.438857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:52.458339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:52.459257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:52.464770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:52.464770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:52.464770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:52.464770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:52.464770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 509/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:52.465081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.481174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.481917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.482267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.482614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.483384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] RBAC: Adding query filter params (type=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:52.483754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.485259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.486487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.491788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 530/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:52.497134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.502963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.581675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68b141-d3c0-42a5-9520-c859ab2977b2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.607783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548049f-af61-4c35-86ee-051d28d06d98 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.616902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.617586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.617910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.618128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.618841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:52.619142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.620498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.633217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 510/1040] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:52.638736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.649609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.650384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.650714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.650992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.651902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] RBAC: Adding query filter params (interface=public, service_id=09c7b0978b124472a0753262c1db2498, region_id=RegionOne) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:52.652251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.653643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.659924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 531/1041] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/endpoints?service_id=09c7b0978b124472a0753262c1db2498&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:52.665595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.729041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.733157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:52.749304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336106ee-06ed-4744-918f-b1062d372373 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.785114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845baae3-dac3-49d6-b6b4-2099a63b38f8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.792760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.793747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.794026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.794294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.801811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.803257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:52.817897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:52.819053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:52.820233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 511/1042] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:52.824733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:52.825360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.826195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.826644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.827068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.827896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.829487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.836990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 532/1043] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:42:52.940428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b370-c982-4475-a429-d387eef24976 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:52.977279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:52.977958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:52.978239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:52.978509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:52.979299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:52.979609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:52.981095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211aa90d-aaa6-4c3e-a435-4ac632991da3 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:52.993638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 512/1044] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:52.999680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:53.107596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594e97a-0885-49d1-ad59-f70b53e00282 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:53.132788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:53.143289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:53.143943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.144224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.144498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:53.145350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] RBAC: Adding query filter params (role.id=3cd9b3e82eae432693c45155ae099ce7, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=624366e88245426a8837e3ce0b714531) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:53.145661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:53.147074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdb0dc-3717-4142-8989-3db41040ba7e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:53.153001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 533/1045] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:52 2022] GET /identity/v3/role_assignments?user.id=624366e88245426a8837e3ce0b714531&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=3cd9b3e82eae432693c45155ae099ce7 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:53.182559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc8a0-6076-45e1-aaf4-e4854d660ca7 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.182892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc8a0-6076-45e1-aaf4-e4854d660ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.183124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc8a0-6076-45e1-aaf4-e4854d660ca7 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:53.184714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 513/1046] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:53.190681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.191014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.191252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:53.211175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:53.212411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:53.289392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 534/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:53.314202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc8a0-6076-45e1-aaf4-e4854d660ca7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:53.328798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:53.423599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc8a0-6076-45e1-aaf4-e4854d660ca7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:53.457546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:53.458359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.458635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.458904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:53.469605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:53.477106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:53.478154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:53.479037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 514/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:53.486396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:53.592349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f990c-c93a-48b4-b656-b596e3ccfa4e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:53.615229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:53.631836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:53.632521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.632808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.633117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:53.633920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:53.634235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:53.635605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:53.648844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 535/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:53.650131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:53.721902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:53.754605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb629a-ecef-477e-9509-d11bbb1c2080 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:53.794448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:53.795327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.795612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.795883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] PATH_INFO: `/v3/users/5ac0583440eb4665a097df048816cd95` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:53.810202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac0583440eb4665a097df048816cd95)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:53.811645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:53.813951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 515/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:42:53 2022] GET /identity/v3/users/5ac0583440eb4665a097df048816cd95 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:53.819754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:53.919211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6213a-0ebd-4819-861b-bf4e6319d312 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:53.954585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:53.955210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:53.955491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:53.955767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:54.006545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:54.026645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:54.028087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:54.126627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 536/1051] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:54.132584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:54.235025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10587-cb23-48bd-b519-8b882cf3a0c8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:54.262748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:54.272473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865ea93-54b5-4ec6-aaf2-ce0d408b6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:54.273389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ea93-54b5-4ec6-aaf2-ce0d408b6d76 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:54.273674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ea93-54b5-4ec6-aaf2-ce0d408b6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:54.273951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865ea93-54b5-4ec6-aaf2-ce0d408b6d76 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:54.275173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865ea93-54b5-4ec6-aaf2-ce0d408b6d76 None admin] RBAC: Authorizing `identity:get_project(project_id=137939eb64464eb0844962d8fc5a8aa4)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:54.276615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865ea93-54b5-4ec6-aaf2-ce0d408b6d76 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:54.283745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 516/1052] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:42:54 2022] GET /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:54.285348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:54.369282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:54.390068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffdde8-88f6-47cf-885d-8cdc0da5b2c4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:54.426705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:54.427367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:54.427655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:54.427932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:54.428765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=137939eb64464eb0844962d8fc5a8aa4, user.id=5ac0583440eb4665a097df048816cd95) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:54.429109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:54.430579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc58f2e-fddd-4db1-8652-aeb35f56da6b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:54.445257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 537/1053] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:42:54 2022] GET /identity/v3/role_assignments?user.id=5ac0583440eb4665a097df048816cd95&scope.project.id=137939eb64464eb0844962d8fc5a8aa4&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:54.920088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028647-3240-4655-9509-881fe9724f61 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:54.920607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028647-3240-4655-9509-881fe9724f61 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:54.920607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028647-3240-4655-9509-881fe9724f61 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:54.922274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 517/1054] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:54.927224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:54.927630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:54.927796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:54.944456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:54.945666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:55.016272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 538/1055] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:55.038868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028647-3240-4655-9509-881fe9724f61 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.141979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028647-3240-4655-9509-881fe9724f61 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.175991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.176787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.177100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.177376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] PATH_INFO: `/v3/services/image` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.178030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:55.179395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-71e89b37-15b3-4c97-9d26-398e70a40f56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:55.191467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:55.192464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:42:55.193400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:55.197249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 518/1056] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:55.198521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.219828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4481-a802-4426-a6dd-0cbdb6fc1dfb None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.220114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4481-a802-4426-a6dd-0cbdb6fc1dfb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.220398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4481-a802-4426-a6dd-0cbdb6fc1dfb None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.221937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 519/1057] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:55.226639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.226928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.227203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.243817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:55.245022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:55.283557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:55.305512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:55.310352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b2c6-5042-4360-a636-e6379bade641 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.320869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 520/1058] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:55.343627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.347462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.348249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.348538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.348813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.349570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:55.349880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:55.351246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:55.356755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 539/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:55.362800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.458074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afc0f1-c3a1-4f81-ac73-63caccbe809f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.473313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10ca5-e60a-4c52-ae7e-369801b66df3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.495198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.496369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.496868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.497354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.508764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:55.511667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.512336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.512620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.512899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.513637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] RBAC: Adding query filter params (type=image) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:55.513945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:55.515316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:55.520033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:55.521137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:55.522073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:55.525097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 521/1060] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:55.526427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 540/1061] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:55.527438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.528692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.534237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:55.583169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:55.636341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f85d08-96a1-40f5-a441-f2ea5cf56160 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.636748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97852-5542-4da2-a857-e36c601e6a04 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.672532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.673219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.673504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.673779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.674536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:55.674825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:55.676183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:55.680223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.681565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.682213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.682779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.683693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:55.684246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 541/1062] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:55.685446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:55.689900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:55.708858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 522/1063] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:42:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:42:55.781218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:55.818797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daaef6-3675-43bc-86cf-64596a86b696 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:55.863330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:55.864136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:55.864423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:55.864698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:55.876873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:55.878381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:55.896415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:55.897459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:55.898410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:55.898410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:55.898410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:55.898410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:55.898410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 542/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:55.904640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.009909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65b9d7-e0bf-4cdb-8b31-55bae8ba126f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.017277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:56.047807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.048493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.048768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.049078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.049804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:56.050113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.051502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.063922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 523/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:56.070055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.175635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6771810-4e13-445d-84ec-3e06683af70c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.190197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:56.213194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.213999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.214287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.214568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.222740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.224202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:42:56.239237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:56.240196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:56.245893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 543/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:56.246500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.348775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c452b0-a206-44a3-a1ad-ae30f5d8c8f6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.382949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.383625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.383908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.384183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.385049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:56.385359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.386793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe03924-2377-4c0c-a55f-58b090f5704b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.409956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 524/1067] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:56.411646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.464325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a903c-4e95-45c0-8bbe-16164792ba4d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.464591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a903c-4e95-45c0-8bbe-16164792ba4d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.464873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a903c-4e95-45c0-8bbe-16164792ba4d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.466279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 525/1068] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:56.471474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174de846-6333-436d-971f-6e7a0326705f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.471763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174de846-6333-436d-971f-6e7a0326705f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.472054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174de846-6333-436d-971f-6e7a0326705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.489441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-174de846-6333-436d-971f-6e7a0326705f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:56.490634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-174de846-6333-436d-971f-6e7a0326705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:56.510116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:56.521727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ab9d-7749-4bdb-9bb0-cc2319b2060c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.557074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.557861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.558141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.558427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.564711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 526/1069] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:56.569554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.571062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.587352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174de846-6333-436d-971f-6e7a0326705f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:56.588788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:56.589872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:56.590813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:56.590813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:56.590813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:56.590813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:56.590813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 544/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:56.595576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.624582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:56.696914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174de846-6333-436d-971f-6e7a0326705f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.701825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf95c2-ce73-4b5a-8aba-21d4321094ab None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.736868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.737351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164842-b019-4201-8213-effe88c485e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.737696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.737981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.738080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164842-b019-4201-8213-effe88c485e4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.738255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.738362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164842-b019-4201-8213-effe88c485e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.738520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03164842-b019-4201-8213-effe88c485e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.739229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164842-b019-4201-8213-effe88c485e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:56.739535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164842-b019-4201-8213-effe88c485e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.740898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03164842-b019-4201-8213-effe88c485e4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.749052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:56.758128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 545/1071] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:56.758296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:56.759196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:56.760067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:56.760721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164842-b019-4201-8213-effe88c485e4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.760794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 527/1072] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:56.767581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.785639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:56.860126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:56.877351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03164842-b019-4201-8213-effe88c485e4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.881584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2d77c-8dd8-401a-98f9-680244db54a1 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:56.917200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.917994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.918277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.918548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.921036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:56.921703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:56.922714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:56.923189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:56.924356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:56.924675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.926109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.926742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:56.928199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:56.939547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 528/1073] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:56.941160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:42:56.942306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:56.943208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:42:56.944135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:56.948280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 546/1074] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:56.949133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:57.022804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:57.052996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4171d-eed8-4158-b96e-e25b63b495d7 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:57.060373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b0f0-5941-4010-ada1-e58d7b8bf730 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:57.094542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:57.095246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.095479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.095748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.096531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:57.096841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:57.097535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:57.098352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:57.098798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.099254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.099696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] PATH_INFO: `/v3/users/5ac0583440eb4665a097df048816cd95` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.101606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac0583440eb4665a097df048816cd95)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:57.103423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:57.106043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 529/1075] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/users/5ac0583440eb4665a097df048816cd95 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:57.111504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:57.111866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 547/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:57.117797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:57.126635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:57.224152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbea50-5a13-49b8-be05-2bb89dbfdc42 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:57.226142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e2156-90c8-4509-b47c-7bb718fa25c2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:57.261205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cbf4c-096b-4f76-814f-20cee8436972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:57.261441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:57.262096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cbf4c-096b-4f76-814f-20cee8436972 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.262203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.262381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cbf4c-096b-4f76-814f-20cee8436972 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.262479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.262652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cbf4c-096b-4f76-814f-20cee8436972 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/624366e88245426a8837e3ce0b714531/roles/3cd9b3e82eae432693c45155ae099ce7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.262749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.263883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] RBAC: Authorizing `identity:get_project(project_id=137939eb64464eb0844962d8fc5a8aa4)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:57.264964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cbf4c-096b-4f76-814f-20cee8436972 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=624366e88245426a8837e3ce0b714531, role_id=3cd9b3e82eae432693c45155ae099ce7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:57.265349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:57.267005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cbf4c-096b-4f76-814f-20cee8436972 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:57.272357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 530/1077] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:42:57 2022] GET /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:57.273281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:57.285549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 548/1078] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:57 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/624366e88245426a8837e3ce0b714531/roles/3cd9b3e82eae432693c45155ae099ce7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:42:57.293902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:57.397650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43e507-900d-44fb-8fcd-a200a855e2d8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:57.438660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43702d4-a84d-4ba5-a81d-d009ffac3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:57.438660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43702d4-a84d-4ba5-a81d-d009ffac3919 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.439094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43702d4-a84d-4ba5-a81d-d009ffac3919 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.439845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43702d4-a84d-4ba5-a81d-d009ffac3919 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4/users/5ac0583440eb4665a097df048816cd95/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.441385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43702d4-a84d-4ba5-a81d-d009ffac3919 None admin] RBAC: Authorizing `identity:create_grant(project_id=137939eb64464eb0844962d8fc5a8aa4, user_id=5ac0583440eb4665a097df048816cd95, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:57.442815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43702d4-a84d-4ba5-a81d-d009ffac3919 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:57.459583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 531/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:42:57 2022] PUT /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4/users/5ac0583440eb4665a097df048816cd95/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:42:57.824617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4cf8f-d132-4cba-8cec-fd122f823167 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.825006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4cf8f-d132-4cba-8cec-fd122f823167 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.825222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4cf8f-d132-4cba-8cec-fd122f823167 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.826737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 549/1080] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:57.832863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:57.834317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:57.834317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:57.853877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:57.855683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:57.930547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 532/1081] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:57.951518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4cf8f-d132-4cba-8cec-fd122f823167 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:58.019480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:58.057870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4cf8f-d132-4cba-8cec-fd122f823167 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:58.092345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:58.093027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:58.093316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:58.094118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:58.162507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:58.164212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:58.227437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:58.271399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 550/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:42:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:42:58.272976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:58.275145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:58.378478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d84af8-14f3-4db1-a95b-8736fd46ca68 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:58.413553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:58.414353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:58.414637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:58.414908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:58.427225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:58.428724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-2803e312-e1e6-416e-a334-1eead32a3494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:42:58.449967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:58.450954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:58.451859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:42:58.451859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:42:58.451859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:42:58.451859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:58.456203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 533/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:58.458108 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:58.570526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60512fd-e01c-4dee-bf47-cf342224c552 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:58.612748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:58.613439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:58.613719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:58.613990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:58.614767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:58.615075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:58.616431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0331c4-e36a-4b52-b1cd-57fa61a3ee1e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:58.633418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 551/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:42:59.389682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6de604-da8a-4dae-9c6f-1563b15ba50f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.390238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6de604-da8a-4dae-9c6f-1563b15ba50f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.390238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6de604-da8a-4dae-9c6f-1563b15ba50f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.391758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 534/1085] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:59.396918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569769-ec21-4a48-acd4-e7fdde1277c9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.397377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569769-ec21-4a48-acd4-e7fdde1277c9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.397490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569769-ec21-4a48-acd4-e7fdde1277c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.414487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d2569769-ec21-4a48-acd4-e7fdde1277c9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:59.415650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d2569769-ec21-4a48-acd4-e7fdde1277c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:59.435877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:59.484080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 552/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:42:59.508725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6de604-da8a-4dae-9c6f-1563b15ba50f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:59.538479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ad071-ac93-42be-b1ca-458c23d3e93a None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.538770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ad071-ac93-42be-b1ca-458c23d3e93a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.539051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ad071-ac93-42be-b1ca-458c23d3e93a None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.540465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 553/1087] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:42:59.545359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.545645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.545927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.563587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:59.564860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:59.566272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:59.612973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6de604-da8a-4dae-9c6f-1563b15ba50f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:59.631539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 554/1088] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:42:59.648055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:59.648795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.649110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.649386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.655225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:59.661358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:59.669979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:59.671007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:42:59.672574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 535/1089] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 5 20:42:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:42:59.677689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:59.745108 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:59.761411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05353a16-6a68-48bc-805b-849f90cf36a7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:59.780968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9f57-5be1-4e46-921c-761ff028d011 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:59.794880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:59.797809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:59.798702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.798883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.799154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.809352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:42:59.815421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:59.816080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.816358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.816629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.817406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:59.817708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:42:59.817898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:42:59.819123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:42:59.820154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:42:59.820808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:59.820880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 555/1090] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:42:59.824778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:59.834045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 536/1091] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:42:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:59.835056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:59.931727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27033dc3-4b22-4567-ba06-6e8eedd37da2 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:59.934769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1207fe-b5ef-420f-a141-bb236da0ffcd None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:59.966502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:59.967165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.967452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.967731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.968482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:42:59.968801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:59.968979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:59.969709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:59.969992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:59.970201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:59.970293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:59.978216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 556/1092] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:42:59.981364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:59.982803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:59.983823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:59.994968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:43:00.001453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:00.002409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:00.003346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:43:00.003346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:43:00.003346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:43:00.003346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:00.003346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 537/1093] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:00.008169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.036840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.088985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc1ac5-1839-4316-91b1-c566d0785484 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.108203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d830ab-45d5-4615-b80d-ed30fff1136a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.122466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.123335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.123616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.123890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] PATH_INFO: `/v3/users/5ac0583440eb4665a097df048816cd95` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.125209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac0583440eb4665a097df048816cd95)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.126640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.128455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 557/1094] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:42:59 2022] GET /identity/v3/users/5ac0583440eb4665a097df048816cd95 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:00.133895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.142539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.143208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.143496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.143775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.144494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:00.144801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.146205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.158650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 538/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:00.164466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.211594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.236121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74621111-2a85-4ae8-87be-32a989918887 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.250774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.263307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b3b4b-764d-4133-8c6c-ac2916e96a34 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.270464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.271116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.271399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.271676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.297411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.298192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.298477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.298750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.305777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.307229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:43:00.321942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:00.323128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:00.324446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 539/1096] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:43:00.329314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.340914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.342387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.418390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.428862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda752f-aee1-46c9-beaf-ef491dbf88a5 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.442764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 558/1097] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:43:00.448484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.466365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.467028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.467306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.467579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.468502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:00.468842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.470538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.492191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 540/1098] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:00.493234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.502575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.549193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384abb6-7a17-4c6f-a75b-b0dafeeafb6a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.585161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.586015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.586295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.586567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.587745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] RBAC: Authorizing `identity:get_project(project_id=137939eb64464eb0844962d8fc5a8aa4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.589200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.590887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 559/1099] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:00.596824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.598098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9fa8-3ced-4429-96ae-c7da1af7a9b6 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.631296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.631933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.632211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.632481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.642594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.698096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32677605-a986-4c6b-a6fc-d67a26503485 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.702138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.703681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.711367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.732713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.733458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.733742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.734016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.735375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=137939eb64464eb0844962d8fc5a8aa4, user.id=5ac0583440eb4665a097df048816cd95) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:00.735688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.737130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.742795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 560/1100] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/role_assignments?user.id=5ac0583440eb4665a097df048816cd95&scope.project.id=137939eb64464eb0844962d8fc5a8aa4&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:00.809363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 541/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:00.815276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.920870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afb65d-1a48-473a-869d-c9b1c1f7687c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.930603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.956873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.957698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.957984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.958258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.969306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.970747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:43:00.987459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:00.988594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:00.990014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:43:00.990014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:43:00.990014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:43:00.990014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:43:00.990014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 561/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:00.994134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:01.094858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ebcaa-8ff5-4596-bc65-65f81bfed02b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:01.103222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:01.131194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:01.131861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:01.132144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:01.132420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:01.133185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:01.133494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:01.134857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:01.146925 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 542/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:01.152418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:01.260122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801afa1-3edf-45f2-b9bd-3421f6e040a8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:01.294254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:01.295042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:01.295325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:01.295600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:01.303069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:01.304656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:43:01.318750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:01.319800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:43:01.320764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 562/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:43:01.325626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:01.424490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9d8fc-2a54-4931-90d8-93620604ad7b None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:01.458602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:01.459245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:01.459518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:01.459819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:01.460697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:01.461039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:01.462468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b412e-47b8-4fa6-886d-d18e77a5b418 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:01.474513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 543/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:01.480508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:01.503361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:01.580454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9e4c-89e1-44b9-934a-16c6e4de14c3 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:01.613388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:01.614035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:01.614321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:01.614599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:01.615430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] RBAC: Adding query filter params (role.id=3cd9b3e82eae432693c45155ae099ce7, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=624366e88245426a8837e3ce0b714531) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:01.615742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:01.617191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192190-f2ec-417a-949c-1553810a8154 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:01.622933 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 563/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:01 2022] GET /identity/v3/role_assignments?user.id=624366e88245426a8837e3ce0b714531&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=3cd9b3e82eae432693c45155ae099ce7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:02.833721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136416-6d3d-4c0f-9428-087ff9dc9690 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:02.834234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136416-6d3d-4c0f-9428-087ff9dc9690 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:02.834234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136416-6d3d-4c0f-9428-087ff9dc9690 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:02.835626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 544/1107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:02.841355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:02.841778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:02.841885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:02.859144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:02.860450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:02.926287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 564/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:02.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51136416-6d3d-4c0f-9428-087ff9dc9690 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:02.977815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:03.051624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51136416-6d3d-4c0f-9428-087ff9dc9690 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:03.084575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a6e5e-75cf-4008-b2e9-0dcb6df06435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:03.085386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a6e5e-75cf-4008-b2e9-0dcb6df06435 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:03.085669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a6e5e-75cf-4008-b2e9-0dcb6df06435 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:03.085944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a6e5e-75cf-4008-b2e9-0dcb6df06435 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:03.087105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a6e5e-75cf-4008-b2e9-0dcb6df06435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:03.088532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a6e5e-75cf-4008-b2e9-0dcb6df06435 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:03.090190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 545/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:03.095952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:03.111284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:03.196895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059cd3a-0d88-4536-bf7f-65b0281cd77f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:03.229194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6faa1c-c1d6-4609-b6c4-279e763477ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:03.229859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6faa1c-c1d6-4609-b6c4-279e763477ab None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:03.230152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6faa1c-c1d6-4609-b6c4-279e763477ab None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:03.230416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6faa1c-c1d6-4609-b6c4-279e763477ab None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:03.231109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6faa1c-c1d6-4609-b6c4-279e763477ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:03.232534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6faa1c-c1d6-4609-b6c4-279e763477ab None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:03.252340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 565/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:43:03 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:43:05.289216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c7e8-ed8f-4a30-9645-6b7a7334f284 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:05.290204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c7e8-ed8f-4a30-9645-6b7a7334f284 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:05.290204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c7e8-ed8f-4a30-9645-6b7a7334f284 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:05.292115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 546/1111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:05.298487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:05.298906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:05.299049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:05.316337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:05.317552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:05.378875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:05.384268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 566/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:05.408996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c7e8-ed8f-4a30-9645-6b7a7334f284 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:05.506132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:05.513803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c7e8-ed8f-4a30-9645-6b7a7334f284 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:05.547672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:05.548484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:05.548767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:05.549067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] PATH_INFO: `/v3/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:05.550544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] RBAC: Authorizing `identity:get_role(role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:05.551905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:05.553290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 547/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:05 2022] GET /identity/v3/roles/ce695803124649b4ad62ca6ec15c935e => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:05.559120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:05.655268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e8be0-9c16-483f-945a-1585f201b2c0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:05.689222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:05.690087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:05.690369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:05.690645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] PATH_INFO: `/v3/users/2dfb285e7b9e4f51a72a687b1fb92922` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:05.703458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfb285e7b9e4f51a72a687b1fb92922)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:05.704888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:05.706558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 567/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:05 2022] GET /identity/v3/users/2dfb285e7b9e4f51a72a687b1fb92922 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:05.712229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:05.810276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f575-3a24-427b-a0f1-c4cdcc3d0a08 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:05.844604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:05.845321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:05.845605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:05.845879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:05.877755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:05.916122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:05.917597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:06.014761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 548/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:43:06.021221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:06.078810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:06.118915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc814-e05f-4f05-8184-2973e027cdf8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:06.152054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b880cbe-e759-4f31-837e-e3328f0cbdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:06.152909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b880cbe-e759-4f31-837e-e3328f0cbdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:06.153265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b880cbe-e759-4f31-837e-e3328f0cbdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:06.153545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b880cbe-e759-4f31-837e-e3328f0cbdd8 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:06.154729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b880cbe-e759-4f31-837e-e3328f0cbdd8 None admin] RBAC: Authorizing `identity:get_project(project_id=137939eb64464eb0844962d8fc5a8aa4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:06.156775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b880cbe-e759-4f31-837e-e3328f0cbdd8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:06.158505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 568/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:06 2022] GET /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:06.164794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:06.230397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:06.269667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9e347-fba4-4e5f-bf4c-3ffc59fe730d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:06.303972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:06.304607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:06.304878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:06.305178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:06.306001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] RBAC: Adding query filter params (role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=137939eb64464eb0844962d8fc5a8aa4, user.id=2dfb285e7b9e4f51a72a687b1fb92922) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:06.306310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:06.307733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384a14f-1897-417f-a445-5fbd581a84ee None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:06.314108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 549/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:06 2022] GET /identity/v3/role_assignments?user.id=2dfb285e7b9e4f51a72a687b1fb92922&scope.project.id=137939eb64464eb0844962d8fc5a8aa4&role.id=ce695803124649b4ad62ca6ec15c935e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:08.349811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc7a67-2dec-4d04-994c-448dd43e3298 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:08.350368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc7a67-2dec-4d04-994c-448dd43e3298 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:08.350368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc7a67-2dec-4d04-994c-448dd43e3298 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:08.351714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 569/1118] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:08.357128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:08.357501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:08.357690 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:08.375448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:08.376621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:08.445664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 550/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:08.469323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc7a67-2dec-4d04-994c-448dd43e3298 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:08.570471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc7a67-2dec-4d04-994c-448dd43e3298 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:08.595619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:08.604592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:08.605418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:08.605704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:08.605979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] PATH_INFO: `/v3/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:08.607444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] RBAC: Authorizing `identity:get_role(role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:08.608914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:08.610648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 570/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:08 2022] GET /identity/v3/roles/ce695803124649b4ad62ca6ec15c935e => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:08.616515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:08.672152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:08.713896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186404c0-a23f-4b8d-9b17-393fa409c32f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:08.747539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:08.748395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:08.748676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:08.748967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] PATH_INFO: `/v3/users/2dfb285e7b9e4f51a72a687b1fb92922` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:08.750449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfb285e7b9e4f51a72a687b1fb92922)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:08.751871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:08.753496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 551/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:08 2022] GET /identity/v3/users/2dfb285e7b9e4f51a72a687b1fb92922 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:08.759372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:08.858331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002904d5-a9c1-4ae6-bffb-b7107e65f7b6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:08.891105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f5407-f527-4709-8a37-18983dfaf860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:08.891960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5407-f527-4709-8a37-18983dfaf860 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:08.892243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5407-f527-4709-8a37-18983dfaf860 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:08.892519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5407-f527-4709-8a37-18983dfaf860 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:08.893715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5407-f527-4709-8a37-18983dfaf860 None admin] RBAC: Authorizing `identity:get_project(project_id=137939eb64464eb0844962d8fc5a8aa4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:08.895156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5407-f527-4709-8a37-18983dfaf860 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:08.896841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 571/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:08 2022] GET /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:08.902812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:09.001592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f238d6-c848-4d5f-b0cc-d385e7997358 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:09.023627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:09.034281 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a10a0-eaba-4fd3-ae06-2351694a8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:09.035149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a10a0-eaba-4fd3-ae06-2351694a8983 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:09.035427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a10a0-eaba-4fd3-ae06-2351694a8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:09.035694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a10a0-eaba-4fd3-ae06-2351694a8983 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4/users/2dfb285e7b9e4f51a72a687b1fb92922/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:09.038150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a10a0-eaba-4fd3-ae06-2351694a8983 None admin] RBAC: Authorizing `identity:create_grant(project_id=137939eb64464eb0844962d8fc5a8aa4, user_id=2dfb285e7b9e4f51a72a687b1fb92922, role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:09.039557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a10a0-eaba-4fd3-ae06-2351694a8983 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:09.052330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 552/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:43:08 2022] PUT /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4/users/2dfb285e7b9e4f51a72a687b1fb92922/roles/ce695803124649b4ad62ca6ec15c935e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:43:11.048668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd18bc-dfda-4286-9e7a-5c3b7ea6e56e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.049225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd18bc-dfda-4286-9e7a-5c3b7ea6e56e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.049331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd18bc-dfda-4286-9e7a-5c3b7ea6e56e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.050646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 572/1124] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:11.055873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.056264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.056429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.073517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:11.074695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:11.139278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 553/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:11.163754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd18bc-dfda-4286-9e7a-5c3b7ea6e56e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:11.225482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:11.265192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd18bc-dfda-4286-9e7a-5c3b7ea6e56e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:11.298903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:11.299685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.299964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.300235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] PATH_INFO: `/v3/roles/ce695803124649b4ad62ca6ec15c935e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.301710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] RBAC: Authorizing `identity:get_role(role_id=ce695803124649b4ad62ca6ec15c935e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:11.303065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:11.304413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 573/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:11 2022] GET /identity/v3/roles/ce695803124649b4ad62ca6ec15c935e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:11.310416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:11.406681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46edf8f-3257-4d88-95f1-a1f2b50156cb None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:11.422085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:11.442412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:11.443282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.443565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.443839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] PATH_INFO: `/v3/users/2dfb285e7b9e4f51a72a687b1fb92922` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.445045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfb285e7b9e4f51a72a687b1fb92922)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:11.446478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:11.448108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 554/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:11 2022] GET /identity/v3/users/2dfb285e7b9e4f51a72a687b1fb92922 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:11.454381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:11.551758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34292a-e136-47fb-ad58-5aab31b2c0df None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:11.580087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:11.586048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:11.586681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.586959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.587231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.651744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:11.653202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:11.748086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 574/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:11.754618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:11.852381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bd6da-d726-49d3-8a26-a186a0fe6986 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:11.884952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2fe9b-b849-4b00-9995-16b66d47d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:11.885814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2fe9b-b849-4b00-9995-16b66d47d667 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.886095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2fe9b-b849-4b00-9995-16b66d47d667 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.886370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2fe9b-b849-4b00-9995-16b66d47d667 None admin] PATH_INFO: `/v3/projects/137939eb64464eb0844962d8fc5a8aa4` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.887529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2fe9b-b849-4b00-9995-16b66d47d667 None admin] RBAC: Authorizing `identity:get_project(project_id=137939eb64464eb0844962d8fc5a8aa4)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:11.888978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2fe9b-b849-4b00-9995-16b66d47d667 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:11.891260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 555/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:11 2022] GET /identity/v3/projects/137939eb64464eb0844962d8fc5a8aa4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:11.897387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:11.926366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:11.994231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8e09e-ee05-4716-9a6c-7323b0662ba8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:12.027175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:12.027813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:12.028092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:12.028361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:12.029205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] RBAC: Adding query filter params (role.id=ce695803124649b4ad62ca6ec15c935e, scope.project.id=137939eb64464eb0844962d8fc5a8aa4, user.id=2dfb285e7b9e4f51a72a687b1fb92922) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:12.029513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:12.031602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61892f28-a4eb-4097-b7dd-5a40ca4e7360 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:12.037507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 575/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:11 2022] GET /identity/v3/role_assignments?user.id=2dfb285e7b9e4f51a72a687b1fb92922&scope.project.id=137939eb64464eb0844962d8fc5a8aa4&role.id=ce695803124649b4ad62ca6ec15c935e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:14.088561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03837d46-b2bf-46d7-ae70-3cb56557587f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:14.089104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03837d46-b2bf-46d7-ae70-3cb56557587f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:14.089228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03837d46-b2bf-46d7-ae70-3cb56557587f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:14.090564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 556/1131] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:14.096502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:14.096983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:14.097085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:14.114760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:14.115932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:14.180125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 576/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:14.204431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03837d46-b2bf-46d7-ae70-3cb56557587f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:14.254931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:14.305869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03837d46-b2bf-46d7-ae70-3cb56557587f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:14.338621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e37843-242b-4482-b1a1-797e5f4ba2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:14.339337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e37843-242b-4482-b1a1-797e5f4ba2aa None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:14.339611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e37843-242b-4482-b1a1-797e5f4ba2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:14.339877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e37843-242b-4482-b1a1-797e5f4ba2aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:14.341058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e37843-242b-4482-b1a1-797e5f4ba2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:14.342473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e37843-242b-4482-b1a1-797e5f4ba2aa None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:14.344201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 557/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:14.349964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:14.374024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:14.447129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9edda-a872-4aa3-afdc-41e4e39867c3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:14.480257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee391cf-82b5-4613-a881-2340dc594fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:14.480902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee391cf-82b5-4613-a881-2340dc594fed None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:14.481213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee391cf-82b5-4613-a881-2340dc594fed None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:14.481484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee391cf-82b5-4613-a881-2340dc594fed None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:14.482187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee391cf-82b5-4613-a881-2340dc594fed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:14.484157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee391cf-82b5-4613-a881-2340dc594fed None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:14.510668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 577/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:43:14 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:43:16.547813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657653-ee78-41a1-bd7a-642c577411ad None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:16.548389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657653-ee78-41a1-bd7a-642c577411ad None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:16.548389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce657653-ee78-41a1-bd7a-642c577411ad None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:16.549845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 558/1135] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:16.555366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:16.555904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:16.556396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:16.573575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:16.574768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:16.640346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 578/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:16.665416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce657653-ee78-41a1-bd7a-642c577411ad None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:16.763408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce657653-ee78-41a1-bd7a-642c577411ad None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:16.781567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:16.798509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a168784-61fd-487f-80aa-ff3600504627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:16.799237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a168784-61fd-487f-80aa-ff3600504627 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:16.799521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a168784-61fd-487f-80aa-ff3600504627 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:16.799796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a168784-61fd-487f-80aa-ff3600504627 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:16.800980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a168784-61fd-487f-80aa-ff3600504627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:16.802416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a168784-61fd-487f-80aa-ff3600504627 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:16.804027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 559/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:43:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:16.809690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:16.818572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:16.913177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc3a5-c3b8-4726-92d1-08b5f0e2a83f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:16.946323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f4b75-c85f-4a06-bc4a-b0c104911b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:16.946983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4b75-c85f-4a06-bc4a-b0c104911b0e None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:16.947269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4b75-c85f-4a06-bc4a-b0c104911b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:16.947550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4b75-c85f-4a06-bc4a-b0c104911b0e None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:16.948263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f4b75-c85f-4a06-bc4a-b0c104911b0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:16.949722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f4b75-c85f-4a06-bc4a-b0c104911b0e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:16.970190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 579/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:43:16 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:43:19.019502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4c6d-aa32-4eed-98ba-bfe600194da1 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:19.020010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4c6d-aa32-4eed-98ba-bfe600194da1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:19.020010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4c6d-aa32-4eed-98ba-bfe600194da1 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:19.021396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 560/1139] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:19.026525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:19.026952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:19.027090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:19.044482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:19.046262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:19.100936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:19.113204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 580/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:19.137168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4c6d-aa32-4eed-98ba-bfe600194da1 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:19.235004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4c6d-aa32-4eed-98ba-bfe600194da1 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:19.267080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:19.267857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:19.268139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:19.268413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:19.278291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:43:19.286286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:19.287762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:19.288725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 561/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:19.293894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:19.390896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871cbd4-5a49-401f-adf2-ff2f01d70b96 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:19.424813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:19.425499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:19.425782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:19.426057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:19.426793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:19.427097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:19.428479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:19.436858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 581/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:19.442610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:19.488358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:19.539705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab867ca-b0ec-435d-9301-b2966480a794 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:19.572518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:19.573398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:19.573679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:19.573952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] PATH_INFO: `/v3/users/8949e7d7337249739cf071db44614a0f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:19.586527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=8949e7d7337249739cf071db44614a0f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:19.587956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:19.589611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 562/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:19 2022] GET /identity/v3/users/8949e7d7337249739cf071db44614a0f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:19.595831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:19.649134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:19.693707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f00a1f-39a6-4f63-8634-8a7440a91110 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:19.725334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:19.725965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:19.726247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:19.726520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:19.791763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:19.793173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:19.846005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:19.890220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 582/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:19.895965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:19.992147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9171-1351-460d-8835-ca826bfc8ac2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:19.994428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:20.024541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7af0-d4d9-4bb7-947e-67883d7f71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:20.025416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7af0-d4d9-4bb7-947e-67883d7f71c8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:20.025691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7af0-d4d9-4bb7-947e-67883d7f71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:20.025958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7af0-d4d9-4bb7-947e-67883d7f71c8 None admin] PATH_INFO: `/v3/projects/e085764535fc4c0a9f529f554cea6f8b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:20.027108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a7af0-d4d9-4bb7-947e-67883d7f71c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e085764535fc4c0a9f529f554cea6f8b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:20.028531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a7af0-d4d9-4bb7-947e-67883d7f71c8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:20.030778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 563/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:19 2022] GET /identity/v3/projects/e085764535fc4c0a9f529f554cea6f8b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:20.036920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:20.131514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788019c-3fdd-4790-bdb7-bbf767fc0f1b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:20.164179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:20.164810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:20.165123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:20.165397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:20.166207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=e085764535fc4c0a9f529f554cea6f8b, user.id=8949e7d7337249739cf071db44614a0f) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:20.166515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:20.167950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa77ad-8f31-46ad-baf6-d84e1a46a26a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:20.173362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 583/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:20 2022] GET /identity/v3/role_assignments?user.id=8949e7d7337249739cf071db44614a0f&scope.project.id=e085764535fc4c0a9f529f554cea6f8b&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:22.181029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bbbc6-df20-4592-b40a-278a5479599c None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:22.181565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bbbc6-df20-4592-b40a-278a5479599c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:22.181686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bbbc6-df20-4592-b40a-278a5479599c None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:22.183987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 564/1147] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:43:22.191112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:22.191572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:22.191668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:22.209054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:22.210226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:22.223308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:22.275207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 584/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:22.299013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bbbc6-df20-4592-b40a-278a5479599c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:22.395674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bbbc6-df20-4592-b40a-278a5479599c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:22.429345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:22.430115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:22.430392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:22.430662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:22.441086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:43:22.448438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:22.449560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:22.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 565/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:22.456397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:22.554566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9c940-2421-4c45-af7d-d5d67c3a54d2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:22.587475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:22.588129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:22.588406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:22.588678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:22.589470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:22.589771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:22.591132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:22.599305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 585/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:22.605147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:22.636527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:22.703883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c0ff-b103-4c3c-b7a8-71954b95adf2 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:22.736086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:22.736958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:22.737247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:22.737521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] PATH_INFO: `/v3/users/8949e7d7337249739cf071db44614a0f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:22.738678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] RBAC: Authorizing `identity:get_user(user_id=8949e7d7337249739cf071db44614a0f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:22.740105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:22.741748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 566/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:22 2022] GET /identity/v3/users/8949e7d7337249739cf071db44614a0f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:22.747705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:22.761343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:22.852736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4621-86c6-4735-b870-3bb05b7fc136 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:22.885164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbc4bb-f38f-43f8-9676-7076cf1aa35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:22.886010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbc4bb-f38f-43f8-9676-7076cf1aa35b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:22.886296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbc4bb-f38f-43f8-9676-7076cf1aa35b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:22.886568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbc4bb-f38f-43f8-9676-7076cf1aa35b None admin] PATH_INFO: `/v3/projects/e085764535fc4c0a9f529f554cea6f8b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:22.887721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbc4bb-f38f-43f8-9676-7076cf1aa35b None admin] RBAC: Authorizing `identity:get_project(project_id=e085764535fc4c0a9f529f554cea6f8b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:22.889335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbc4bb-f38f-43f8-9676-7076cf1aa35b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:22.891676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 586/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:22 2022] GET /identity/v3/projects/e085764535fc4c0a9f529f554cea6f8b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:22.897716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:22.991878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:22.994612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95854b2-2a1c-4aad-b95e-3b7dcfc7e004 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:23.028615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5130e-d1f5-41a2-8f4e-b778fa2b0299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:23.029525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5130e-d1f5-41a2-8f4e-b778fa2b0299 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:23.029808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5130e-d1f5-41a2-8f4e-b778fa2b0299 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:23.030079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5130e-d1f5-41a2-8f4e-b778fa2b0299 None admin] PATH_INFO: `/v3/projects/e085764535fc4c0a9f529f554cea6f8b/users/8949e7d7337249739cf071db44614a0f/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:23.032026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5130e-d1f5-41a2-8f4e-b778fa2b0299 None admin] RBAC: Authorizing `identity:create_grant(project_id=e085764535fc4c0a9f529f554cea6f8b, user_id=8949e7d7337249739cf071db44614a0f, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:23.033496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5130e-d1f5-41a2-8f4e-b778fa2b0299 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:23.046517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 567/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:43:22 2022] PUT /identity/v3/projects/e085764535fc4c0a9f529f554cea6f8b/users/8949e7d7337249739cf071db44614a0f/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:43:25.064684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6882-50ed-4dae-ba3a-faa72974f2ce None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:25.065261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6882-50ed-4dae-ba3a-faa72974f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:25.065368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6882-50ed-4dae-ba3a-faa72974f2ce None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:25.066688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 587/1154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:25.071836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:25.072239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:25.072396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:25.089160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:25.090342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:25.156172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 568/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:25.180330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6882-50ed-4dae-ba3a-faa72974f2ce None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:25.256671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:25.278233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6882-50ed-4dae-ba3a-faa72974f2ce None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:25.312655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:25.313602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:25.313887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:25.314165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:25.323985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:43:25.332045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:25.333229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:43:25.334302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 588/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:25.339142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:25.428531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:25.438586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0c843-0cda-42cb-adee-831a608d920c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:25.472609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:25.473306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:25.473592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:25.473869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:25.474609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:25.474918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:25.476293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:25.484252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 569/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:25.489961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:25.585755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115636-fb28-4dec-8550-4547e1742cf0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:25.617706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:25.618550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:25.618828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:25.619100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] PATH_INFO: `/v3/users/8949e7d7337249739cf071db44614a0f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:25.620252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] RBAC: Authorizing `identity:get_user(user_id=8949e7d7337249739cf071db44614a0f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:25.621705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:25.623289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 589/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:25 2022] GET /identity/v3/users/8949e7d7337249739cf071db44614a0f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:25.629027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:25.725135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe7215-71c3-4002-b19e-3f00177d6c16 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:25.756442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:25.757101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:25.757380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:25.757703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:25.778675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:25.824130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:25.825614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:25.921530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 570/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:25.927315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:25.937465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:26.026964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8d09a-9088-461d-a00e-d7ff33239275 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:26.061553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f7c52-979a-4ad7-b8aa-bfc2c68939c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:26.062405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7c52-979a-4ad7-b8aa-bfc2c68939c7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:26.062690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7c52-979a-4ad7-b8aa-bfc2c68939c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:26.062968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f7c52-979a-4ad7-b8aa-bfc2c68939c7 None admin] PATH_INFO: `/v3/projects/e085764535fc4c0a9f529f554cea6f8b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:26.064140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7c52-979a-4ad7-b8aa-bfc2c68939c7 None admin] RBAC: Authorizing `identity:get_project(project_id=e085764535fc4c0a9f529f554cea6f8b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:26.065603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f7c52-979a-4ad7-b8aa-bfc2c68939c7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:26.067294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 590/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:25 2022] GET /identity/v3/projects/e085764535fc4c0a9f529f554cea6f8b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:26.073427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:26.124923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:26.171088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b5269-59b4-4467-b7e9-6dbfecb1d58e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:26.203775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:26.204353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:26.204634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:26.204909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:26.205757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=e085764535fc4c0a9f529f554cea6f8b, user.id=8949e7d7337249739cf071db44614a0f) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:26.206063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:26.207486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33089-90bf-4e7e-ac32-ad15473a66dc None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:26.213050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 571/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:26 2022] GET /identity/v3/role_assignments?user.id=8949e7d7337249739cf071db44614a0f&scope.project.id=e085764535fc4c0a9f529f554cea6f8b&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:28.245629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444deb-45a5-4d9f-bc70-3548b09a6b9c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:28.246162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444deb-45a5-4d9f-bc70-3548b09a6b9c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:28.246162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444deb-45a5-4d9f-bc70-3548b09a6b9c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:28.247543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 591/1162] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:28.252737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:28.253157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:28.253334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:28.269821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:28.270997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:28.335960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 572/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:28.359576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444deb-45a5-4d9f-bc70-3548b09a6b9c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:28.435247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:28.461402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444deb-45a5-4d9f-bc70-3548b09a6b9c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:28.494992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:28.495623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:28.495956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:28.496186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:28.570234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:28.571709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:28.642241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:28.667124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 592/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:28.673653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:28.718078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:28.769902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71b1b3-7bb0-4061-9335-e1abadb71302 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:28.803508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:28.804302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:28.804583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:28.804855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:28.811963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:28.813427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-8fcc4131-a50e-4872-8e0b-c21f8810ee57 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:28.827337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:28.828642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:28.829786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 573/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:43:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:28.834413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:28.947204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5846de-e4d2-4812-abd6-503a553638a8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:28.980661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:28.981343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:28.981626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:28.981901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:28.982619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:28.983825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:28.985267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c85c-d923-48b1-ae88-12c2001f1265 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:28.992211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 593/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 5 20:43:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:30.996368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e765-860d-4d5f-a91d-30e52e0232c4 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:30.996895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e765-860d-4d5f-a91d-30e52e0232c4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:30.996895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6e765-860d-4d5f-a91d-30e52e0232c4 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:30.999045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 574/1167] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:31.004393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dd0fe-7e78-4fea-856f-19e9b5d30cd9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:31.004814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dd0fe-7e78-4fea-856f-19e9b5d30cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:31.004967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dd0fe-7e78-4fea-856f-19e9b5d30cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:31.021354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f57dd0fe-7e78-4fea-856f-19e9b5d30cd9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:31.022470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f57dd0fe-7e78-4fea-856f-19e9b5d30cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:31.051115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:31.087087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 594/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:31.110320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e765-860d-4d5f-a91d-30e52e0232c4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:31.209437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6e765-860d-4d5f-a91d-30e52e0232c4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:31.216154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:31.243299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982d6f-7af7-4be3-b9a9-fe0041e2cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:31.243958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982d6f-7af7-4be3-b9a9-fe0041e2cd68 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:31.244241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982d6f-7af7-4be3-b9a9-fe0041e2cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:31.244518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982d6f-7af7-4be3-b9a9-fe0041e2cd68 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:31.245289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6982d6f-7af7-4be3-b9a9-fe0041e2cd68 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:31.246655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6982d6f-7af7-4be3-b9a9-fe0041e2cd68 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:31.260222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 575/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Jul 5 20:43:31 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:43:33.284853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd4d6-b64f-4983-ad83-9d1f1bdc9d45 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:33.285440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd4d6-b64f-4983-ad83-9d1f1bdc9d45 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:33.285440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd4d6-b64f-4983-ad83-9d1f1bdc9d45 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:33.286788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 595/1170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:33.292068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:33.292470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:33.292621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:33.309277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:33.310438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:33.379991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 576/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:33.403895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fd4d6-b64f-4983-ad83-9d1f1bdc9d45 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:33.503115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fd4d6-b64f-4983-ad83-9d1f1bdc9d45 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:33.536468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c504-fcb1-42fc-bffd-ee47ea43d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:33.537595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c504-fcb1-42fc-bffd-ee47ea43d857 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:33.537876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c504-fcb1-42fc-bffd-ee47ea43d857 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:33.538146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c504-fcb1-42fc-bffd-ee47ea43d857 None admin] PATH_INFO: `/v3/domains/4b9c883d9d3a4b0984ef128f7124b935` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:33.548253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c504-fcb1-42fc-bffd-ee47ea43d857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b9c883d9d3a4b0984ef128f7124b935)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:33.549720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c504-fcb1-42fc-bffd-ee47ea43d857 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:33.551331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 596/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jul 5 20:43:33 2022] GET /identity/v3/domains/4b9c883d9d3a4b0984ef128f7124b935 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:33.557295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:33.647051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:33.653438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e474-7d7f-4fd9-aacf-0d074ebbd12c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:33.686823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82012cfa-7dff-48e8-93f5-1553c7361bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:33.687472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82012cfa-7dff-48e8-93f5-1553c7361bae None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:33.687754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82012cfa-7dff-48e8-93f5-1553c7361bae None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:33.688032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82012cfa-7dff-48e8-93f5-1553c7361bae None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:33.688753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82012cfa-7dff-48e8-93f5-1553c7361bae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:33.690218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82012cfa-7dff-48e8-93f5-1553c7361bae None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:33.714212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 577/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:43:33 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:43:35.744894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93240623-b8bb-4db2-a91b-62dbcf672d04 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:35.745563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93240623-b8bb-4db2-a91b-62dbcf672d04 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:35.745563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93240623-b8bb-4db2-a91b-62dbcf672d04 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:35.746858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 597/1174] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:35.752564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:35.753029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:35.753139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:35.770627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:35.771814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:35.836938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 578/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:35.861472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93240623-b8bb-4db2-a91b-62dbcf672d04 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:35.890459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:35.962850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93240623-b8bb-4db2-a91b-62dbcf672d04 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:35.996033 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333d25e-b5b7-4f23-93fe-1ecf1701a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:35.996833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d25e-b5b7-4f23-93fe-1ecf1701a631 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:35.997146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d25e-b5b7-4f23-93fe-1ecf1701a631 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:35.997425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333d25e-b5b7-4f23-93fe-1ecf1701a631 None admin] PATH_INFO: `/v3/domains/4b9c883d9d3a4b0984ef128f7124b935` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:35.999084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333d25e-b5b7-4f23-93fe-1ecf1701a631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b9c883d9d3a4b0984ef128f7124b935)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:36.000535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333d25e-b5b7-4f23-93fe-1ecf1701a631 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:36.002186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 598/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jul 5 20:43:35 2022] GET /identity/v3/domains/4b9c883d9d3a4b0984ef128f7124b935 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:36.008060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:36.083447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:36.106130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6bf41-fff8-4ad6-9e12-cae62235bddf None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:36.139146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834828fb-3a08-415c-9eaa-63d41f6b0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:36.139829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834828fb-3a08-415c-9eaa-63d41f6b0d23 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:36.140109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834828fb-3a08-415c-9eaa-63d41f6b0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:36.140386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834828fb-3a08-415c-9eaa-63d41f6b0d23 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:36.141106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834828fb-3a08-415c-9eaa-63d41f6b0d23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:36.142547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834828fb-3a08-415c-9eaa-63d41f6b0d23 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:36.162629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 579/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:43:36 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:43:38.250064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46509d-90fe-41c3-8521-51aef73014dd None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:38.250624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46509d-90fe-41c3-8521-51aef73014dd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:38.250624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46509d-90fe-41c3-8521-51aef73014dd None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:38.251982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 599/1178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:38.257313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:38.257684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:38.257871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:38.274261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:38.275430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:38.342065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 580/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:38.365348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46509d-90fe-41c3-8521-51aef73014dd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:38.458614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:38.465705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46509d-90fe-41c3-8521-51aef73014dd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:38.504385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:38.505127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:38.505410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:38.505686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:38.515583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:43:38.523141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:38.529036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:43:38.530248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 600/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:38.531368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:38.596439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:38.633718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f21972-5805-48b8-b5c2-7060e19aecd6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:38.666643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:38.667302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:38.667579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:38.667851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:38.668581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:38.668886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:38.670880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:38.678617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 581/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:38.684362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:38.792648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b7f00-7c22-4d42-968a-66b0fbab3b5e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:38.825872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:38.827289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:38.827561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:38.827831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] PATH_INFO: `/v3/users/53f9061be56148048378eb447b9b87cf` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:38.840323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] RBAC: Authorizing `identity:get_user(user_id=53f9061be56148048378eb447b9b87cf)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:38.841930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:38.843527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 601/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:38 2022] GET /identity/v3/users/53f9061be56148048378eb447b9b87cf => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:38.849299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:38.946357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3124298-581b-443d-a479-05d81ff91a20 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:38.971303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:38.979774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:38.980414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:38.980697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:38.980995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:39.046350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:39.047802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:39.142355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 582/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:39.148329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:39.163776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:39.244747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86913175-4623-4cf3-bbfd-40bf5a8db084 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:39.277300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b939d-0a05-4965-9ec2-223351930b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:39.278143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b939d-0a05-4965-9ec2-223351930b8b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:39.278422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b939d-0a05-4965-9ec2-223351930b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:39.278694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b939d-0a05-4965-9ec2-223351930b8b None admin] PATH_INFO: `/v3/projects/f1d307df65df46e4a16708398ef70e09` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:39.280598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b939d-0a05-4965-9ec2-223351930b8b None admin] RBAC: Authorizing `identity:get_project(project_id=f1d307df65df46e4a16708398ef70e09)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:39.282049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b939d-0a05-4965-9ec2-223351930b8b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:39.283733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 602/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:39 2022] GET /identity/v3/projects/f1d307df65df46e4a16708398ef70e09 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:39.290138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:39.317504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:39.388688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db1d9a-e2ad-40cb-9806-987d51ca61e8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:39.422205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:39.422848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:39.423130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:39.423401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:39.424211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=f1d307df65df46e4a16708398ef70e09, user.id=53f9061be56148048378eb447b9b87cf) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:39.424512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:39.425954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c971641-5db2-483c-9ea5-bd11b6d075c9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:39.431160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 583/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:39 2022] GET /identity/v3/role_assignments?user.id=53f9061be56148048378eb447b9b87cf&scope.project.id=f1d307df65df46e4a16708398ef70e09&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:41.437401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6a9cd-d061-488c-8a8b-726d9a001b88 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:41.437975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6a9cd-d061-488c-8a8b-726d9a001b88 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:41.437975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6a9cd-d061-488c-8a8b-726d9a001b88 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:41.439319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 603/1186] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:41.444475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:41.444914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:41.445050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:41.462046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:41.463227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:41.528601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 584/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:41.552635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6a9cd-d061-488c-8a8b-726d9a001b88 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:41.647565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:41.674516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6a9cd-d061-488c-8a8b-726d9a001b88 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:41.710196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:41.710959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:41.711241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:41.711515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:41.722003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:43:41.729560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:41.730993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:43:41.732846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 604/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:41.737905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:41.759758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:41.839605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc87e5a-9e27-441e-bcc8-02d2b0bae338 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:41.878609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:41.879443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:41.879931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:41.880421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:41.881802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:41.882127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:41.883845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:41.893813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 585/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:41.901076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:42.016494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee1ac-9e92-41b6-b078-c0532cf16273 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:42.060120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:42.061997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:42.062463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:42.062925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] PATH_INFO: `/v3/users/53f9061be56148048378eb447b9b87cf` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:42.064533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] RBAC: Authorizing `identity:get_user(user_id=53f9061be56148048378eb447b9b87cf)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:42.066024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:42.067663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 605/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:41 2022] GET /identity/v3/users/53f9061be56148048378eb447b9b87cf => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:43:42.074265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:42.166876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:42.187419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46e7b9-ae44-4c63-8efa-33c8789241b9 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:42.226446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c20545-6a26-4af7-840d-43be44efd609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:42.227325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c20545-6a26-4af7-840d-43be44efd609 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:42.227609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c20545-6a26-4af7-840d-43be44efd609 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:42.227880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c20545-6a26-4af7-840d-43be44efd609 None admin] PATH_INFO: `/v3/projects/f1d307df65df46e4a16708398ef70e09` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:42.229548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c20545-6a26-4af7-840d-43be44efd609 None admin] RBAC: Authorizing `identity:get_project(project_id=f1d307df65df46e4a16708398ef70e09)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:42.230996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c20545-6a26-4af7-840d-43be44efd609 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:42.232724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 586/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:42 2022] GET /identity/v3/projects/f1d307df65df46e4a16708398ef70e09 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:42.238787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:42.251492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:42.349817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4beb-b3b5-438e-8bed-0c18a65bff54 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:42.385575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88378e59-b89c-4b59-a6f3-1865149358f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:42.386458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88378e59-b89c-4b59-a6f3-1865149358f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:42.386738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88378e59-b89c-4b59-a6f3-1865149358f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:42.387011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88378e59-b89c-4b59-a6f3-1865149358f9 None admin] PATH_INFO: `/v3/projects/f1d307df65df46e4a16708398ef70e09/users/53f9061be56148048378eb447b9b87cf/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:42.389941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88378e59-b89c-4b59-a6f3-1865149358f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1d307df65df46e4a16708398ef70e09, user_id=53f9061be56148048378eb447b9b87cf, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:42.391470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88378e59-b89c-4b59-a6f3-1865149358f9 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:42.405203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 606/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:43:42 2022] PUT /identity/v3/projects/f1d307df65df46e4a16708398ef70e09/users/53f9061be56148048378eb447b9b87cf/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:43:44.446351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce604d-2ffd-4aaa-8899-51bb1e5a3e8a None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:44.446902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce604d-2ffd-4aaa-8899-51bb1e5a3e8a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:44.446902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce604d-2ffd-4aaa-8899-51bb1e5a3e8a None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:44.448279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 587/1193] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:44.453927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:44.454354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:44.454496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:44.470887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:44.472085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:44.532802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:44.538477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 607/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:43:44.562904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce604d-2ffd-4aaa-8899-51bb1e5a3e8a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:44.670122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce604d-2ffd-4aaa-8899-51bb1e5a3e8a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:44.702406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:44.703123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:44.703410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:44.703683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:44.713423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:43:44.721723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:43:44.722902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:43:44.723789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 588/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:43:44.729103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:44.831512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5c5f1-e144-4ee3-b397-581d25edf2c0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:44.865492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:44.866151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:44.866433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:44.866708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:44.867449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:44.867756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:44.869149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:44.877943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 608/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:44.883812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:44.897240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:44.984000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e0cb-61c9-4d5e-a88a-72e1bd4a91c4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:45.018780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:45.019647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:45.019930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:45.020196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] PATH_INFO: `/v3/users/53f9061be56148048378eb447b9b87cf` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:45.021411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] RBAC: Authorizing `identity:get_user(user_id=53f9061be56148048378eb447b9b87cf)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:45.022852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:45.024499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 589/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 5 20:43:44 2022] GET /identity/v3/users/53f9061be56148048378eb447b9b87cf => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:45.030476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:45.090621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:45.128675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed30c37-51fb-4ed5-b1e9-ba0e904ee5f8 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:45.162015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:45.162652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:45.162936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:45.163213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:45.228715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:45.230202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:45.289043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:45.328654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 609/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:43:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:43:45.334500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:45.412126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:45.434116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1bd48-176a-4c94-97c0-c68d99a7a284 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:45.466933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb614bbb-f122-4a1d-8458-b5827bd38bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:45.467785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb614bbb-f122-4a1d-8458-b5827bd38bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:45.468061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb614bbb-f122-4a1d-8458-b5827bd38bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:45.468329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb614bbb-f122-4a1d-8458-b5827bd38bc0 None admin] PATH_INFO: `/v3/projects/f1d307df65df46e4a16708398ef70e09` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:45.469513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb614bbb-f122-4a1d-8458-b5827bd38bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=f1d307df65df46e4a16708398ef70e09)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:45.470941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb614bbb-f122-4a1d-8458-b5827bd38bc0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:45.472644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 590/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 5 20:43:45 2022] GET /identity/v3/projects/f1d307df65df46e4a16708398ef70e09 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:45.478695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:45.574716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3637-c795-4d0b-9f72-35bc4c05fa0b None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:45.607884 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:45.608520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:45.608799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:45.609108 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:45.609925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=f1d307df65df46e4a16708398ef70e09, user.id=53f9061be56148048378eb447b9b87cf) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:43:45.610232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:45.611654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe136e-703a-488d-9b8f-91c3b96e9404 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:45.617416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 610/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:43:45 2022] GET /identity/v3/role_assignments?user.id=53f9061be56148048378eb447b9b87cf&scope.project.id=f1d307df65df46e4a16708398ef70e09&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:43:55.462296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=27 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:55.614769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=87 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:41.588853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f171-2bb2-4b84-b6d9-4e91130de422 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:41.588853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f171-2bb2-4b84-b6d9-4e91130de422 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:41.588853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1f171-2bb2-4b84-b6d9-4e91130de422 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:41.590238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 591/1201] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:44:41.595687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:41.596175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:41.596289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:41.615867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:41.620188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:41.705128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 611/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:44:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:44:41.724992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f171-2bb2-4b84-b6d9-4e91130de422 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:41.861544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1f171-2bb2-4b84-b6d9-4e91130de422 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:41.902405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:41.903217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:41.903545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:41.903761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:41.921674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:41.923643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:41.942612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:41.944005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:41.945268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:41.945268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:41.945268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:41.945268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:41.945268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 592/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:41.954262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:42.084116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb8499-39b4-4034-8fc1-4134248d9fb0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:42.120865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:42.129207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:42.129897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:42.130177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:42.130450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:42.131190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:42.131539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:42.133114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50e37c-b31f-4a3c-bc2a-fbe4be23e3a8 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:42.148716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 612/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:42.154886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:42.239315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:42.303746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62cbd-4304-4133-84f6-28bc2e794a30 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:42.350347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf884e2-b80c-4120-b9a7-d6327c07e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:42.351033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf884e2-b80c-4120-b9a7-d6327c07e674 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:42.351314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf884e2-b80c-4120-b9a7-d6327c07e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:42.351584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf884e2-b80c-4120-b9a7-d6327c07e674 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:42.352289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf884e2-b80c-4120-b9a7-d6327c07e674 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:42.353831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf884e2-b80c-4120-b9a7-d6327c07e674 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:42.385076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 593/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 5 20:44:42 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:44:44.836024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323b7fe-3df4-460d-bfed-6b9e24bf1a8b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:44.836590 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323b7fe-3df4-460d-bfed-6b9e24bf1a8b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:44.836590 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323b7fe-3df4-460d-bfed-6b9e24bf1a8b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:44.838202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 613/1206] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:44:44.843716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:44.844193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:44.844291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:44.863540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:44.864901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:44.940971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 594/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:44:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:44:44.967625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323b7fe-3df4-460d-bfed-6b9e24bf1a8b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:45.096596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323b7fe-3df4-460d-bfed-6b9e24bf1a8b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:45.139580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:45.140387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:45.140685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:45.140960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:45.153536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:44:45.162438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:45.164739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:45.165730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 614/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:44:45.170456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:45.216048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:45.286114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cee1c-faca-49bb-b270-6febc27ec7f7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:45.324601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:45.325424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:45.325735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:45.325987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:45.326853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:45.327222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:45.328759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:45.339271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 595/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:45.345030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:45.401413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:45.468501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afabeb-eb7d-4af7-a09f-0217332a4ee9 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:45.512588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:45.513493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:45.513846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:45.514126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:45.527250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:45.528723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:45.548977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:45.549991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:45.550908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:45.550908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:45.550908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:45.550908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:45.550908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 615/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:44:45.556084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:45.678891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:45.682454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ada767-0cd2-4526-a51a-8de49afb547c None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:45.721439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:45.722270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:45.722640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:45.722988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:45.723790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:45.725188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:45.725636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:45.740031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 596/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:45.746686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:45.874127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eea18-061a-4f90-953f-971ff08aca1a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:45.875821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:45.913736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:45.914521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:45.914824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:45.915078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:45.923582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:45.925664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:44:45.947061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:45.948989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:45.951821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 616/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:45.956251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.075799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421c8c-8112-4e84-b0c7-2e3519b60ed0 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.123440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.124132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.124413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.124683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.125632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:46.125864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.127309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.146597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 597/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 5 20:44:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:46.152840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.281064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c96aca-a666-4e58-af5c-1e023a1f3d5f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.326724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.327388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.327677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.327937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.360430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:46.403267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.404866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.528686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 617/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:44:46.535958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.559886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:46.668233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85df97d-5475-444a-a2f1-e7973b911497 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.716056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.717503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.717927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.718374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.729871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.731341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:46.752126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:46.753393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:46.754337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:46.754337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:46.754337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:46.754337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:46.759182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.763180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 598/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:46.840555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:46.884439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae298f7-4a79-443a-b835-7871ea7a5899 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.938696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.939421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.939709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.940062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.940903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:46.941246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.944700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.957887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 618/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:44:46.964407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:47.044550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:47.080424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02274-42de-448d-bb4a-4372560a8df4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:47.124066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:47.124879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.125194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.125506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.134673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.136355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:44:47.158804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:47.159947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:44:47.161351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:47.163692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 599/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:47.168209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:47.281970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af237-222c-4684-8eb9-b998109752bd None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:47.308731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:47.328157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:47.328826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.329141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.329419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.330199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:47.330507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.331955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210e518-2962-40e2-9ab3-c622d3ff2982 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.350838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 619/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:47.352501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:47.469268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150ce6a-a0c5-46d7-9314-219fa4c6143d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:47.506314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:47.514195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:47.515027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.515310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.515586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.516428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=3acb6587f284491ea5854898abfbc4fb) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:47.516738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.518889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09513d88-3d7d-4f3a-bf4b-7c7d09ceeedf None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.524112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 600/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:44:47 2022] GET /identity/v3/role_assignments?user.id=3acb6587f284491ea5854898abfbc4fb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:49.574370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd992-d58d-4c51-87a9-107d3e407638 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:49.574961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd992-d58d-4c51-87a9-107d3e407638 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:49.574961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd992-d58d-4c51-87a9-107d3e407638 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:49.576335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 620/1220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:44:49.582338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:49.582780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:49.582903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:49.606861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:49.608053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:49.676529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 601/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:44:49.703522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd992-d58d-4c51-87a9-107d3e407638 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:49.820137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd992-d58d-4c51-87a9-107d3e407638 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:49.858169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:49.859010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:49.859299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:49.859577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:49.873214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:44:49.881833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:49.883057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:49.884130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 621/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:49.892735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:49.997183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3e29-32b6-4dfa-ae02-d84284af6983 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:50.021265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:50.033604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:50.034317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:50.034552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:50.034821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:50.035821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:50.036126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:50.037530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:50.048372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 602/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:44:50.054126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:50.100223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:50.163178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff903d42-2c20-44bf-b16e-5dc9f272f53c None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:50.199820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:50.200675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:50.201001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:50.201296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:50.212600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:50.215104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:50.235582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:50.236741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:50.237850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:50.237850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:50.237850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:50.237850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:50.237850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 622/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:50.242815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:50.348605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a61b0-84a1-4480-be33-e19b2e6badd8 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:50.386620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:50.388157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:50.388397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:50.388756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:50.389509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:50.389895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:50.391724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:50.405321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 603/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:44:50.411570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:50.522773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:50.531144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec87a1d-58c7-49c5-9a45-db573929cbc6 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:50.571093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:50.571925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:50.572355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:50.572837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:50.580481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:50.581981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:44:50.597078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:50.598405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:50.599438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 623/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:50.604674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:50.654026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:50.716849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c8b66-a826-467d-9df0-7d7aa22812ed None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:50.752257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:50.752920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:50.753225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:50.753496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:50.754320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:50.754623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:50.756045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:50.773810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 604/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 5 20:44:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:44:50.780157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:50.893175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446af78-5ea3-4910-98aa-b9ae208a1f98 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:50.932209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:50.933524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:50.934063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:50.934547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:50.946384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:50.948606 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:50.967875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:50.969062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:50.970251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:50.970251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:50.970251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:50.970251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:50.973085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 624/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:50.975012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:51.086002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d9b58-4850-48d8-b537-58ae5435f4a7 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:51.088477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:51.123372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:51.124049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:51.124324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:51.124598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:51.125363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:51.125672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:51.127046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:51.140013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 605/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:51.145837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:51.155682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:51.260813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba5bc6-0d04-486c-8341-b954ab8d35f4 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:51.301434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:51.302410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:51.302729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:51.303037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:51.311423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:51.313244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:44:51.328707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:51.329750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:51.330661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 625/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:51.335808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:51.455215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef79bc0-4f9e-47a0-ac57-bc8737ecddae None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:51.496548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:51.497246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:51.497527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:51.497809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:51.498613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:51.498907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:51.500466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9e4d-ed4a-4280-a105-d30c1186b6e8 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:51.515135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 606/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:51.521921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:51.594455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:51.632983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45386b80-98ca-455e-aa36-306e1170ad13 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:51.667684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846b408-bd96-487f-a7e7-27e62483381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:51.668700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b408-bd96-487f-a7e7-27e62483381f None admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:51.669023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b408-bd96-487f-a7e7-27e62483381f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:51.669347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846b408-bd96-487f-a7e7-27e62483381f None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/3acb6587f284491ea5854898abfbc4fb/roles/75cf0d70e0714de787dc3d4433d61951` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:51.685818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846b408-bd96-487f-a7e7-27e62483381f None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=3acb6587f284491ea5854898abfbc4fb, role_id=75cf0d70e0714de787dc3d4433d61951)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:51.687265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846b408-bd96-487f-a7e7-27e62483381f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:51.699632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 626/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:44:51 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/3acb6587f284491ea5854898abfbc4fb/roles/75cf0d70e0714de787dc3d4433d61951 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:44:53.713107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d8c46-677d-4f80-8116-accf05043cbf None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:53.713892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d8c46-677d-4f80-8116-accf05043cbf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:53.713892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d8c46-677d-4f80-8116-accf05043cbf None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:53.715015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 607/1233] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:44:53.720125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:53.720645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:53.720762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:53.737877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:53.739210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:53.817427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 627/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:44:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:44:53.842178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d8c46-677d-4f80-8116-accf05043cbf None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:53.872623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:53.959629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d8c46-677d-4f80-8116-accf05043cbf None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:53.997194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:53.997987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:53.998261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:53.998591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:54.010108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:44:54.018181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:54.019366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:54.020378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 608/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 5 20:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:54.025996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:54.076356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:54.133144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36b178-aad1-4c15-a3d2-c859956955dc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:54.171674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:54.172382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:54.172665 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:54.173015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:54.173779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:54.174093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:54.175622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:54.187108 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 628/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 5 20:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:54.193167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:54.283157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:54.303201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f8f2e-2df8-42a9-b9a5-4257ea226953 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:54.347766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:54.348649 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:54.348964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:54.349237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:54.364775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:54.366333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:54.385439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:54.386591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:54.387669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:54.387669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:54.387669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:54.387669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:54.387669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 609/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:54.392580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:54.507640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88ddc9-bcc6-4346-a0f7-be9532039de1 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:54.518486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:54.550114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:54.550774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:54.551056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:54.551338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:54.552066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:54.552362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:54.553768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:54.567729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 629/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:54.574310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:54.692429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50489e-c337-4c19-a1e3-e8fbef35bc6f None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:54.730153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:54.730970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:54.731425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:54.731545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:54.734477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:54.740576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:54.742169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:44:54.757862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:54.759648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:54.770386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 610/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:54.771697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:54.879054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34d205-8d6c-4f1b-85a7-e713529ffc5f None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:54.916079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:54.916753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:54.917068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:54.917344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:54.918179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:54.918486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:54.919916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:54.937504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 630/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 5 20:44:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:54.943326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:55.063507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503d6e-9914-4017-92be-de9af9b5ab23 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:55.102080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:55.103542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:55.103867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:55.104147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:55.171081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:55.179111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:55.180580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:55.292191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 611/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:44:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:44:55.299106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:55.332000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:55.407479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ced11-e271-4331-b66b-2df24448c75e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:55.445589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:55.446305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:55.447320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:55.447647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:55.460332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:55.462002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:55.482024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:55.483114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:55.484069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:55.484069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:55.484069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:55.484069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:55.484069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 631/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:55.489136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:55.588653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:55.594512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18796c-65c7-4c22-b662-0e17fe23984e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:55.630560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:55.631231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:55.631591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:55.631866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:55.632578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:55.632883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:55.635056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:55.647443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 612/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:55.653840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:55.740262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:55.766454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44360-64ca-4dd0-a391-48f75962b3b5 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:55.810119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:55.811110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:55.811399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:55.811706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:55.820104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:55.822796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:44:55.838563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:55.839713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:44:55.841041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 632/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:55.845716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:55.960105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad90b5d-e5a2-464a-bc13-098701ce2315 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:56.000742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:56.001369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:56.001752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:56.002006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:56.002745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:56.003093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:56.004681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39ff6e-f1e0-4685-b3cd-a15768d19f08 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:56.018499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 613/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:56.024626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:56.136403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f149829-90a8-4f08-af5b-56f8fbd20d80 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:56.174669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:56.175328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:56.175608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:56.175925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:56.176745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] RBAC: Adding query filter params (role.id=75cf0d70e0714de787dc3d4433d61951, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=3acb6587f284491ea5854898abfbc4fb) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:56.177111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:56.178567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b239e4-0a20-43b0-b4d5-c6cde1da4063 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:56.184963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 633/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:44:56 2022] GET /identity/v3/role_assignments?user.id=3acb6587f284491ea5854898abfbc4fb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=75cf0d70e0714de787dc3d4433d61951 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:58.641838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63526a2-8f3c-4804-b074-448880975b76 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:58.642417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63526a2-8f3c-4804-b074-448880975b76 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:58.642535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63526a2-8f3c-4804-b074-448880975b76 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:58.643889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 614/1247] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:44:58.649772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:58.650331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:58.650594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:58.656053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:58.670132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:58.671706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:58.746396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 634/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:44:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:44:58.770569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63526a2-8f3c-4804-b074-448880975b76 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:58.790402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:58.887437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63526a2-8f3c-4804-b074-448880975b76 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:58.927679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:58.928390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:58.928673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:58.928965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:58.941439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:44:58.949721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:58.950885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:58.951784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 615/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:58.957365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:59.071972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64113f63-d13e-4295-8551-6e0294a365bd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:59.106280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:59.113914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:59.114605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:59.114898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:59.115159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:59.116055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:59.116431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:59.117953 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:59.128018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 635/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:59.133955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:59.218877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:59.244510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b1cb-3fab-43e5-ba09-8493d4ac097e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:59.284069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:59.285170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:59.285486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:59.285869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:59.300494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:59.302064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:44:59.322648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:59.325150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:59.326086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:44:59.326086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:44:59.326086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:44:59.326086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:59.326086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 616/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:59.329626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:59.446423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b8575-807c-47bb-ab57-20124169ce82 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:59.488018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:59.488803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:59.489172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:59.489537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:59.490497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:59.490849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:59.492423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:59.506277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 636/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:59.512323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:59.626936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e36f07-598b-46f4-ad7a-413e43ce8715 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:59.659214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:59.669308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:59.670286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:59.670568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:59.670889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:59.679147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:59.681534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:44:59.700756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:44:59.701870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:44:59.702846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 617/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:44:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:44:59.708893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:59.776893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:59.829565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9de24b-05ed-4a83-ad38-026f0aac7cdc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:59.864805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:59.865626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:59.865960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:59.866298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:59.867200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:59.867573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:59.869679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:59.887722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 637/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 5 20:44:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:59.893536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:59.999555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eeea08-e4a8-4131-adce-b6b524ea5715 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:00.036160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:00.036871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:00.037182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:00.037488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:00.097687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:00.112620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:00.114156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:00.223758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 618/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:44:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:45:00.230673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:00.343127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f509df2-d98c-41aa-a789-c5e1270e9bf7 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:00.357223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:00.378919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:00.379708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:00.379990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:00.380265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:00.390691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:00.392188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:45:00.412209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:00.413414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:00.414644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:45:00.414644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:45:00.414644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:00.414644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:00.419280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 638/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:00.420570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:00.517344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:00.530141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbce0b-bda8-4131-a08c-03aa57548e0d None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:00.566435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:00.567100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:00.567383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:00.567656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:00.568365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:00.568672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:00.570090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:00.587465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 619/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:00.588718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:00.699050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3260-0970-4be2-9915-54cd0113ac69 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:00.735759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:00.736579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:00.736867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:00.737162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:00.745556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:00.747049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:45:00.763037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:00.764031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:00.765100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 639/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:45:00.769057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:00.875476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34898a27-cd76-4197-ba13-c9f3bfe7acb4 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:00.911682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:00.912356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:00.912637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:00.912909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:00.913729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:00.914037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:00.915592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23c108-526e-4188-8cf8-bfe5386785ef None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:00.928763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 620/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:00.935265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:00.963177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:01.046668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b73bdf-47ac-4acb-82eb-04c8aee50029 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:01.082579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:01.083252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:01.083532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:01.083801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:01.084644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=3acb6587f284491ea5854898abfbc4fb) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:01.084979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:01.086443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81315a2-b18a-4cb9-a3a3-769cdcc6b06e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:01.096984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 640/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:45:00 2022] GET /identity/v3/role_assignments?user.id=3acb6587f284491ea5854898abfbc4fb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:03.124376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945fdd7-0524-46ad-9183-2357b65aa036 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:03.124907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945fdd7-0524-46ad-9183-2357b65aa036 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:03.124907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945fdd7-0524-46ad-9183-2357b65aa036 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:03.126348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 621/1261] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:45:03.131558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:03.132008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:03.132106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:03.148306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:45:03.149517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:45:03.214177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 641/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:45:03.237138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945fdd7-0524-46ad-9183-2357b65aa036 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:03.248804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:03.337980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945fdd7-0524-46ad-9183-2357b65aa036 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:03.370975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:03.371749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:03.372030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:03.372303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:03.382049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:45:03.389840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:03.390956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:03.392005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 622/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:03.397017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:03.416141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:03.500612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502cb4-8587-4a29-ba75-4df05565de4e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:03.533716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:03.534378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:03.534916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:03.535196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:03.535933 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:03.536240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:03.537634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:03.546321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 642/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:03.551975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:03.617163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:03.650709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9051b-56b6-47f9-ba9a-87e58453b9ac None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:03.683412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:03.684188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:03.684472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:03.684749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:03.694953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:03.697035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:45:03.713731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:03.714769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:03.715900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:45:03.715900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:45:03.715900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:03.715900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:03.715900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 623/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:03.720791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:03.800094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:03.819547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d19784-a376-4b64-8c61-509b9c38b47a None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:03.851842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:03.853098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:03.853389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:03.853667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:03.854384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:03.854691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:03.856051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:03.867975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 643/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:03.874498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:03.972912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05947f8f-3dcd-4c93-8f12-d44d28e72179 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:03.991894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:04.006068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.006856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.007143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.007419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.015425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.016864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:45:04.031479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:04.032620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:04.033993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 624/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:04.038621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:04.140025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a17fa-481a-4acb-8aa4-c84636789858 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:04.176008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.176835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.177188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.177461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.178454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:04.178809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.180221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:04.188762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:04.198465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 644/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 5 20:45:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:04.203994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:04.301374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8061-6bfe-467c-a253-ff72e83aaa90 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:04.333483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.334250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.334531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.334803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.345617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.347048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:45:04.364282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:04.365391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:04.366517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:45:04.366517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:45:04.366517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:04.366517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:04.366517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 625/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:04.371119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:04.474215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9f0f7-27ea-48dc-a59a-93afe3e5281e None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:04.507217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.507865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.508154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.508430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.510068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:04.510376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.511742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:04.522908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 645/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:04.529632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:04.560691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:04.628183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c30ddc-9381-433f-ad16-61bc95e4080a None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:04.660228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.661031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.661319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.661597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.668684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.670179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:45:04.684204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:04.685374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:04.686608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 626/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:04.691116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:04.752014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:04.794539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048befd4-0c48-4a02-9706-2f543cdbad75 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:04.827611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.828201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.828487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.828764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.829576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:04.829886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.831313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d6f9f-43c8-4b55-9005-48d1a1217c2d None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:04.842968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 646/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:04.848814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:04.940429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:04.949864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49492c-d3a6-4432-96b8-44eaa61b1ea0 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:04.982423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6d37d-51df-44a7-818e-ecc8da4da263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:04.983301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d37d-51df-44a7-818e-ecc8da4da263 None admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:04.983585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d37d-51df-44a7-818e-ecc8da4da263 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:04.983861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6d37d-51df-44a7-818e-ecc8da4da263 None admin] PATH_INFO: `/v3/projects/d789fcfd78754c508c8b9b828d354534/users/3acb6587f284491ea5854898abfbc4fb/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:04.985888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d37d-51df-44a7-818e-ecc8da4da263 None admin] RBAC: Authorizing `identity:create_grant(project_id=d789fcfd78754c508c8b9b828d354534, user_id=3acb6587f284491ea5854898abfbc4fb, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:04.987378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6d37d-51df-44a7-818e-ecc8da4da263 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:05.001791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 627/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 5 20:45:04 2022] PUT /identity/v3/projects/d789fcfd78754c508c8b9b828d354534/users/3acb6587f284491ea5854898abfbc4fb/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:45:06.995765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81486aa8-b59e-4e1a-8a6c-4cbb42669404 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:06.996287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81486aa8-b59e-4e1a-8a6c-4cbb42669404 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:06.996404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81486aa8-b59e-4e1a-8a6c-4cbb42669404 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:06.997712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 647/1274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:45:07.002795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:07.003167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:07.003342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:07.020438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:45:07.021563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:45:07.087775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 628/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:45:07.111215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81486aa8-b59e-4e1a-8a6c-4cbb42669404 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:07.209817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81486aa8-b59e-4e1a-8a6c-4cbb42669404 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:07.226662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:07.244438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:07.245249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:07.245539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:07.245797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:07.255475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:45:07.263779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:07.264920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:07.265905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 648/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 5 20:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:07.270836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:07.350282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:07.369319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591987cf-731d-4f46-a6ae-ac7641b2a6db None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:07.402370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:07.403038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:07.403310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:07.403587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:07.404323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:07.404631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:07.406034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:07.414146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 629/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 5 20:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:07.421037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:07.522272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a09c2-a849-4f52-b728-ccd05dd5b4db None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:07.555572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:07.556355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:07.556638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:07.556914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:07.567228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:07.568685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:45:07.585841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:07.587585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:07.588816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:45:07.588816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:45:07.588816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:07.588816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:07.588816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 649/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:07.593438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:07.690350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208260-0405-497e-a186-8c5a0e487417 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:07.721617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:07.722262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:07.722539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:07.722809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:07.723513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:07.723812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:07.725189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:07.736883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 630/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:07.743413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:07.774993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:07.844746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff9e23-7541-4585-b823-c8efd7036315 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:07.882274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:07.883067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:07.883459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:07.883735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:07.891071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:07.892497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:45:07.906787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:07.908025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:07.909412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 650/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:07.914408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:07.918819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:08.010579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed6f5a-fdaf-4da6-9160-8cc8b0639fc1 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:08.042636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:08.043292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:08.043569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:08.043837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:08.044645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:08.044965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:08.046375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:08.063225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 631/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 5 20:45:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:08.068891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:08.158080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:08.168669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d858f-65fa-4158-8059-07a1ed148dae None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:08.201460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:08.202090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:08.202371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:08.202644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:08.268855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:08.270320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:08.354655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:08.365012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 651/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 5 20:45:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:45:08.371647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:08.435362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:08.474033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b96a3-63bc-4c76-8fe0-f5da2061f83e None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:08.507672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:08.508561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:08.509096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:08.509381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:08.519013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:08.520463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:45:08.537965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:08.539060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:08.540867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:45:08.540867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:45:08.540867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:45:08.540867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:08.540867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 632/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:08.545386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:08.642792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f1a6a-29fc-4dbd-a39e-93d7c5d95e96 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:08.677296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:08.677942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:08.678221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:08.678491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:08.679193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:08.679494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:08.681063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:08.691982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 652/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 5 20:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:08.697698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:08.796236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583aa8d-fe9d-45d1-961e-da91b6c15785 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:08.809667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:08.829280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:08.830058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:08.830335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:08.830605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:08.837685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:08.839109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:45:08.852990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:08.854071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: ERROR keystone.server.flask.application Jul 05 20:45:08.855385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 633/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 5 20:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:08.860587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:08.910052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:08.959896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21ce5-a1c3-45a2-9896-e042376a8da0 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:08.993367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:08.994018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:08.994307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:08.994584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:08.995354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:08.995661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:08.997105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5c0c-65e6-42b7-819b-89aef6b5fa0c None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:09.008842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 653/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 5 20:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:09.014782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:09.113936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001d7c-8548-4207-b3df-13d166af87ba None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:09.146022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:09.146662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:09.146939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:09.147204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:09.148013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] RBAC: Adding query filter params (role.id=a570a4bfca4f44058b14bbbabd43dd0d, scope.project.id=d789fcfd78754c508c8b9b828d354534, user.id=3acb6587f284491ea5854898abfbc4fb) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:09.148315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:09.149902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19d83-861a-4d08-8a98-96d17c6fc808 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:09.155509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 634/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 5 20:45:09 2022] GET /identity/v3/role_assignments?user.id=3acb6587f284491ea5854898abfbc4fb&scope.project.id=d789fcfd78754c508c8b9b828d354534&role.id=a570a4bfca4f44058b14bbbabd43dd0d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:11.174302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2f75e-94e3-4d17-85cb-179d9f1398f2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:11.174877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2f75e-94e3-4d17-85cb-179d9f1398f2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:11.174976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2f75e-94e3-4d17-85cb-179d9f1398f2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:11.176460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 654/1288] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:45:11.182243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:11.182670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:11.182799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:11.199576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:45:11.200739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:45:11.229288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:11.265813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 635/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:45:11.291362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2f75e-94e3-4d17-85cb-179d9f1398f2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:11.396346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2f75e-94e3-4d17-85cb-179d9f1398f2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:11.407139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:11.433150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:11.433944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:11.434271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:11.434580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:11.435337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:11.436810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:11.451010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:11.452296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:11.453439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 655/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:45:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:45:11.458720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:11.558816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e26de-0ad5-4fb9-aef4-136a2531a88a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:11.591969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:11.592622 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:11.592905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:11.593215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:11.593915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:11.594220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:11.595598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a88d2e-a6bf-4278-80f3-a1b213a43251 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:11.600320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 636/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 5 20:45:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:11.606868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:11.706072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbd3f-3da8-4994-8673-21163eb8f1cc None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:11.738513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:11.739159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:11.739445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:11.739718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] PATH_INFO: `/v3/services` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:11.740411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:11.740714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:11.742106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d59953-e051-4553-9550-653d1ab07d23 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:11.746438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 656/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 5 20:45:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:13.768951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be126a7-7c49-4ac6-8d20-02de046177f9 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:13.769357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be126a7-7c49-4ac6-8d20-02de046177f9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:13.769509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be126a7-7c49-4ac6-8d20-02de046177f9 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:13.770894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 637/1293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:45:13.776199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc93e-32dd-4f75-9ab3-c551cd20dcf1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:13.776595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc93e-32dd-4f75-9ab3-c551cd20dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:13.776748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdc93e-32dd-4f75-9ab3-c551cd20dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:13.794028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9ccdc93e-32dd-4f75-9ab3-c551cd20dcf1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:45:13.795195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9ccdc93e-32dd-4f75-9ab3-c551cd20dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:45:13.824189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:13.861132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 657/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:45:13.884106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be126a7-7c49-4ac6-8d20-02de046177f9 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:13.915470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:13.983077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be126a7-7c49-4ac6-8d20-02de046177f9 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:14.015658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7e1b9-2f0f-4616-b230-afea41e27a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:14.016245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e1b9-2f0f-4616-b230-afea41e27a44 None admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:14.016526 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e1b9-2f0f-4616-b230-afea41e27a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:14.016801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e1b9-2f0f-4616-b230-afea41e27a44 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:14.017533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7e1b9-2f0f-4616-b230-afea41e27a44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:14.018887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7e1b9-2f0f-4616-b230-afea41e27a44 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:14.031667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 638/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 5 20:45:13 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:45:16.115929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afe44b-74f8-4d1d-afcf-72c24eeb0400 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:16.116456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afe44b-74f8-4d1d-afcf-72c24eeb0400 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:16.116456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afe44b-74f8-4d1d-afcf-72c24eeb0400 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:16.117891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 658/1296] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:45:16.123066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:16.123508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:16.123613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:16.140134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:45:16.141360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:45:16.212164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 639/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:45:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:45:16.236020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afe44b-74f8-4d1d-afcf-72c24eeb0400 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:16.337896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afe44b-74f8-4d1d-afcf-72c24eeb0400 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:16.371153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:16.371872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:16.372153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:16.372425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:16.373103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:16.374461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:16.387036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:16.388233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:16.389291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 659/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:45:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:16.394119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:16.412222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:16.500444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72adce57-f1da-40b5-abb2-21ac395685f1 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:16.532555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:16.533246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:16.533531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:16.533802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:16.534758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:16.535057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:16.536414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:16.542050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 640/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 5 20:45:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:16.547991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:16.579326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:16.646152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b90ac6-eb7b-45fa-b479-e8d9e692ef03 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:16.678713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:16.679407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:16.679776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:16.680213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:16.680993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] RBAC: Adding query filter params (interface=public, service_id=9ea4678c2e8c497997d91cdf5ac12d7d, region_id=RegionOne) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:16.681307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:16.682658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96e6ba-d826-44c7-b181-d053e67e1fac None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:16.687543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 660/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 5 20:45:16 2022] GET /identity/v3/endpoints?service_id=9ea4678c2e8c497997d91cdf5ac12d7d&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:45:16.693200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:16.780237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:16.798758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738893c-3eb6-453f-94e5-f7b6b9b1f149 None admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:16.831890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6f2d1-6146-439f-8c3c-4df86b4bf2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:16.832538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f2d1-6146-439f-8c3c-4df86b4bf2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:16.832817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f2d1-6146-439f-8c3c-4df86b4bf2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:16.833117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6f2d1-6146-439f-8c3c-4df86b4bf2f6 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:16.833787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f2d1-6146-439f-8c3c-4df86b4bf2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:16.835137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6f2d1-6146-439f-8c3c-4df86b4bf2f6 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:16.841785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 641/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 5 20:45:16 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:45:18.862317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb6d2-5890-4809-9c4d-e0afb78e6384 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:18.862853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb6d2-5890-4809-9c4d-e0afb78e6384 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:18.862853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb6d2-5890-4809-9c4d-e0afb78e6384 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:18.864245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 661/1302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:45:18.869431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:18.869868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:18.869966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:18.886777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:45:18.887941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:45:18.951766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 642/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:45:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:45:18.975197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb6d2-5890-4809-9c4d-e0afb78e6384 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:19.070713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:19.077895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb6d2-5890-4809-9c4d-e0afb78e6384 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:19.112591 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:19.113425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:19.113704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:19.113977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:19.114619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:19.115979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:45:19.130460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:45:19.131690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: ERROR keystone.server.flask.application Jul 05 20:45:19.132598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 662/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 5 20:45:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:45:19.137897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:19.211917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:19.234687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475645-8c4a-4c89-aea4-857a4b6acc80 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:19.267823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:19.268477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:19.268758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:19.269062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] PATH_INFO: `/v3/services` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:19.269761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:45:19.270063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:19.271430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096366-106d-4170-9dcb-eecc3bdd34d1 None admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:19.276783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 643/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 5 20:45:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:45:19.282265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:45:19.379042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a90be2-048e-4248-ab10-f9c04dd7aa16 None admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:45:19.411629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45645-70f7-40c2-870c-52d88d35e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:45:19.412274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45645-70f7-40c2-870c-52d88d35e40e None admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:45:19.412557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45645-70f7-40c2-870c-52d88d35e40e None admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:45:19.412827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45645-70f7-40c2-870c-52d88d35e40e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:45:19.413587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45645-70f7-40c2-870c-52d88d35e40e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:45:19.415148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a45645-70f7-40c2-870c-52d88d35e40e None admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:45:19.432687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 663/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 5 20:45:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:45:29.273444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=30 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:45:29.427794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:22.453455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716109ca-acbe-4706-8dec-59db9e49b423 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:22.454490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716109ca-acbe-4706-8dec-59db9e49b423 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:22.454989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716109ca-acbe-4706-8dec-59db9e49b423 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:22.461412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 644/1307] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:22.462693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259579a-b9fa-414e-bd28-cc0d56973bad None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:22.463116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259579a-b9fa-414e-bd28-cc0d56973bad None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:22.463346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259579a-b9fa-414e-bd28-cc0d56973bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:22.605730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8259579a-b9fa-414e-bd28-cc0d56973bad None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:22.608368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8259579a-b9fa-414e-bd28-cc0d56973bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:22.831429 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 664/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:46:22.896047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17df4cd-ee8e-4505-af0b-d8e240707822 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:22.896451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17df4cd-ee8e-4505-af0b-d8e240707822 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:22.896840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17df4cd-ee8e-4505-af0b-d8e240707822 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:22.899287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 645/1309] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jul 5 20:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:22.913278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa2a88-19ca-4f99-92ea-eced2a694ca5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:22.913594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa2a88-19ca-4f99-92ea-eced2a694ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:22.913864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa2a88-19ca-4f99-92ea-eced2a694ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:23.073852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3faa2a88-19ca-4f99-92ea-eced2a694ca5 None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:23.075494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3faa2a88-19ca-4f99-92ea-eced2a694ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:23.104099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:23.175514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 665/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jul 5 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:23.185967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17df4cd-ee8e-4505-af0b-d8e240707822 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:23.189171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f17df4cd-ee8e-4505-af0b-d8e240707822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:23.325214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17df4cd-ee8e-4505-af0b-d8e240707822 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:23.403705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:23.404392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:23.404668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:23.404954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:23.406698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:23.466833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:23.533049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:23.534765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c1551-65a7-4636-b4da-5a2f4dc8bf85 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:23.555343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 646/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:25.958883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3ff5b-9a37-4761-83e8-1c3823b2260d None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:25.960046 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3ff5b-9a37-4761-83e8-1c3823b2260d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:25.960149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3ff5b-9a37-4761-83e8-1c3823b2260d None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:25.961571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 666/1312] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:25.966909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5927-2d89-4063-93a9-74dcebf34894 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:25.967363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5927-2d89-4063-93a9-74dcebf34894 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:25.967470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f5927-2d89-4063-93a9-74dcebf34894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:26.058134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e51f5927-2d89-4063-93a9-74dcebf34894 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:26.059377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e51f5927-2d89-4063-93a9-74dcebf34894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:26.161559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 647/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:46:26.214857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3dd60-ea90-46fe-a871-7a54adf28a48 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:26.215240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3dd60-ea90-46fe-a871-7a54adf28a48 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:26.215528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3dd60-ea90-46fe-a871-7a54adf28a48 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:26.216910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 667/1314] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jul 5 20:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:26.222909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31174-3c37-4087-aeaf-98cd4fe723c7 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:26.223202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31174-3c37-4087-aeaf-98cd4fe723c7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:26.223479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f31174-3c37-4087-aeaf-98cd4fe723c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:26.234402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:26.311422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b0f31174-3c37-4087-aeaf-98cd4fe723c7 None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:26.312577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b0f31174-3c37-4087-aeaf-98cd4fe723c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:26.388671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 648/1315] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jul 5 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:46:26.397924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3dd60-ea90-46fe-a871-7a54adf28a48 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:26.399939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4bb3dd60-ea90-46fe-a871-7a54adf28a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:26.504052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3dd60-ea90-46fe-a871-7a54adf28a48 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:26.573766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:26.576523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:26.577242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:26.577726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:26.578209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:26.580016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:26.695737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:26.697269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b856e-8f20-4392-90ea-db50a9c87177 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:26.716958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 668/1316] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:29.288639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d038-39e4-42d6-9385-9990431c0b9f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:29.289211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d038-39e4-42d6-9385-9990431c0b9f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:29.289211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d038-39e4-42d6-9385-9990431c0b9f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:29.290617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 649/1317] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:29.295806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e08bd-bd67-4c95-92a9-d4a5f160d53b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:29.296267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e08bd-bd67-4c95-92a9-d4a5f160d53b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:29.296376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e08bd-bd67-4c95-92a9-d4a5f160d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:29.359573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c62e08bd-bd67-4c95-92a9-d4a5f160d53b None None] MFA Rules not processed for user `85b501a53389476b8ec65a6de4cce2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:29.360768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c62e08bd-bd67-4c95-92a9-d4a5f160d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:29.411635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:29.461147 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 669/1318] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:29.501311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d038-39e4-42d6-9385-9990431c0b9f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:29.502840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6a80d038-39e4-42d6-9385-9990431c0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:29.605211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d038-39e4-42d6-9385-9990431c0b9f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:29.607933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:29.679204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:29.679852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:29.680138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:29.680415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:29.682338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:29.790396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:29.791833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a10f9d-157e-412e-95c6-c5ffd029cdbc service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:29.809918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 650/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:32.379761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12a4a9-3e03-4f23-a987-419b12714232 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:32.380340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12a4a9-3e03-4f23-a987-419b12714232 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:32.380340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12a4a9-3e03-4f23-a987-419b12714232 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:32.382311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 670/1320] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:32.387380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed2dd-ce05-4bb9-a18b-e73f103f1b7c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:32.387787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed2dd-ce05-4bb9-a18b-e73f103f1b7c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:32.388002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ed2dd-ce05-4bb9-a18b-e73f103f1b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:32.427632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:32.455378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-704ed2dd-ce05-4bb9-a18b-e73f103f1b7c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:32.456597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-704ed2dd-ce05-4bb9-a18b-e73f103f1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:32.551675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 651/1321] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:32.590440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12a4a9-3e03-4f23-a987-419b12714232 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:32.591975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dc12a4a9-3e03-4f23-a987-419b12714232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:32.697879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12a4a9-3e03-4f23-a987-419b12714232 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:32.770538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:32.771190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:32.771965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:32.772251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:32.773931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:32.782640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:32.885832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:32.887266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cc228-6130-44f7-97fd-77584319821b service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:32.905598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 671/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:35.654963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd582-cea1-4e81-848d-7ab83509a09a None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:35.655500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd582-cea1-4e81-848d-7ab83509a09a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:35.655500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd582-cea1-4e81-848d-7ab83509a09a None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:35.656904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 652/1323] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:35.663285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d9a0-5b2d-4cee-a6e4-9497839685d8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:35.663693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d9a0-5b2d-4cee-a6e4-9497839685d8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:35.663844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d9a0-5b2d-4cee-a6e4-9497839685d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:35.728548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d8c4d9a0-5b2d-4cee-a6e4-9497839685d8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:35.729779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d8c4d9a0-5b2d-4cee-a6e4-9497839685d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:35.798299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:35.842292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 672/1324] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:35.878766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd582-cea1-4e81-848d-7ab83509a09a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:35.880351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7a2cd582-cea1-4e81-848d-7ab83509a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:35.987556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd582-cea1-4e81-848d-7ab83509a09a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:35.999905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:36.062748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:36.063396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:36.063673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:36.063942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:36.065669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:36.175484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:36.176806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1cad8-0b36-4983-9101-d93b8a4eca37 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:36.195561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 653/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:46:38.328066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5435-4dc6-4f03-8b41-02c396aa4e20 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:38.328628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5435-4dc6-4f03-8b41-02c396aa4e20 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:38.328628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5435-4dc6-4f03-8b41-02c396aa4e20 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:38.330025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 673/1326] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:38.336104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820bacd-616f-4ff5-9520-d873dd2c53e4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:38.336517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820bacd-616f-4ff5-9520-d873dd2c53e4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:38.336634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820bacd-616f-4ff5-9520-d873dd2c53e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:38.383021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:38.402377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-7820bacd-616f-4ff5-9520-d873dd2c53e4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:38.403596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7820bacd-616f-4ff5-9520-d873dd2c53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:38.507191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 654/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:38.550354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5435-4dc6-4f03-8b41-02c396aa4e20 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:38.551911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-feef5435-4dc6-4f03-8b41-02c396aa4e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:38.659157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5435-4dc6-4f03-8b41-02c396aa4e20 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:38.735676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:38.736327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:38.736607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:38.736879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:38.738585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:38.757036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:38.864194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:38.866224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13c72e-98ce-47d5-b751-710b21340d83 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:38.885281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 674/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:40.991636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c337c-8ce8-4776-b7d7-534e384d417b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:40.992202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c337c-8ce8-4776-b7d7-534e384d417b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:40.992202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c337c-8ce8-4776-b7d7-534e384d417b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:40.993527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 655/1329] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:40.998909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92c100-e255-4e5e-b808-489883061894 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:40.999364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92c100-e255-4e5e-b808-489883061894 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:40.999465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92c100-e255-4e5e-b808-489883061894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:41.067731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9c92c100-e255-4e5e-b808-489883061894 None None] MFA Rules not processed for user `85b501a53389476b8ec65a6de4cce2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:41.069009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9c92c100-e255-4e5e-b808-489883061894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:41.137110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:41.170193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 675/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:41.208984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c337c-8ce8-4776-b7d7-534e384d417b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:41.210723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-479c337c-8ce8-4776-b7d7-534e384d417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:41.316290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c337c-8ce8-4776-b7d7-534e384d417b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:41.337799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:41.391940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:41.392594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:41.392884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:41.393194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:41.394837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:41.529957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:41.531415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500cc7a-776c-4f53-abd6-88413de06e8e service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:41.551755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 656/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:43.869387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d6db3-17e5-487b-96ff-d310b67c6e91 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:43.869917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d6db3-17e5-487b-96ff-d310b67c6e91 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:43.869917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d6db3-17e5-487b-96ff-d310b67c6e91 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:43.871329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 676/1332] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:46:43.876640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0c9e-9332-4534-9378-51678e751715 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:43.877138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0c9e-9332-4534-9378-51678e751715 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:43.877241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0c9e-9332-4534-9378-51678e751715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:43.939161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:43.942152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-bfec0c9e-9332-4534-9378-51678e751715 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:43.944091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-bfec0c9e-9332-4534-9378-51678e751715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:44.044564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 657/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:44.079653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d6db3-17e5-487b-96ff-d310b67c6e91 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:44.081206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-112d6db3-17e5-487b-96ff-d310b67c6e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:44.183504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d6db3-17e5-487b-96ff-d310b67c6e91 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:44.255334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:44.255974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:44.256250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:44.256518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:44.258164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:44.283977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:44.365445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:44.366819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d53c9f-45c1-47a0-85a3-c4eb785ca027 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:44.385032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 677/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:46.624225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f97ae-d858-430c-8684-cb0b1df80387 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:46.624778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f97ae-d858-430c-8684-cb0b1df80387 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:46.624778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f97ae-d858-430c-8684-cb0b1df80387 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:46.626191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 658/1335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:46.632074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22b1d-4435-44dc-82c7-2fd4d0464d0e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:46.632512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22b1d-4435-44dc-82c7-2fd4d0464d0e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:46.632625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22b1d-4435-44dc-82c7-2fd4d0464d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:46.696800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dda22b1d-4435-44dc-82c7-2fd4d0464d0e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:46.697995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dda22b1d-4435-44dc-82c7-2fd4d0464d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:46.773283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:46.796272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 678/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:46:46.836392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f97ae-d858-430c-8684-cb0b1df80387 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:46.839201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6f9f97ae-d858-430c-8684-cb0b1df80387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:46.940810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f97ae-d858-430c-8684-cb0b1df80387 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:46.969705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:47.020016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:47.021362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:47.021635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:47.021907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:47.023532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:47.137945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:47.139380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e1096-96ed-4236-b631-2b4ffdb2db58 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:47.158695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 659/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:49.509500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6030-c54c-43f0-92cf-57cf4b852d61 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:49.510059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6030-c54c-43f0-92cf-57cf4b852d61 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:49.510059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b6030-c54c-43f0-92cf-57cf4b852d61 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:49.511447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 679/1338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:49.516745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bafdff-0914-493b-8580-a02d57d72f25 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:49.517218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bafdff-0914-493b-8580-a02d57d72f25 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:49.517354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bafdff-0914-493b-8580-a02d57d72f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:49.586145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-29bafdff-0914-493b-8580-a02d57d72f25 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:49.588210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-29bafdff-0914-493b-8580-a02d57d72f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:49.596754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:49.688208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 660/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:49.724301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b6030-c54c-43f0-92cf-57cf4b852d61 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:49.725982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4c3b6030-c54c-43f0-92cf-57cf4b852d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:49.830773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b6030-c54c-43f0-92cf-57cf4b852d61 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:49.903191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:49.903758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:49.904037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:49.904308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:49.905957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:49.941847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:50.014585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:50.016018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d02850-dd2e-425b-84b6-cb8266a0fdb3 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:50.034543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 680/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:54.099720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d025b-17c2-4b49-93ba-c7240a4f7ac5 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:54.100231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d025b-17c2-4b49-93ba-c7240a4f7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:54.100231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d025b-17c2-4b49-93ba-c7240a4f7ac5 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:54.101610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 661/1341] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:54.107067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba6fa-fdbb-40f7-8613-7c5ef7e766f6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:54.107517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba6fa-fdbb-40f7-8613-7c5ef7e766f6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:54.107618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cba6fa-fdbb-40f7-8613-7c5ef7e766f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:54.180912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b2cba6fa-fdbb-40f7-8613-7c5ef7e766f6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:54.182074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b2cba6fa-fdbb-40f7-8613-7c5ef7e766f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:54.275987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:54.290220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 681/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:54.327949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d025b-17c2-4b49-93ba-c7240a4f7ac5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:54.330232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-de1d025b-17c2-4b49-93ba-c7240a4f7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:54.427677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d025b-17c2-4b49-93ba-c7240a4f7ac5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:54.431849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2ebe9-33b7-4ef7-95db-edfd12ac0872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:54.432656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2ebe9-33b7-4ef7-95db-edfd12ac0872 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:54.433024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2ebe9-33b7-4ef7-95db-edfd12ac0872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:54.433369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2ebe9-33b7-4ef7-95db-edfd12ac0872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:54.443748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2ebe9-33b7-4ef7-95db-edfd12ac0872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:54.445234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2ebe9-33b7-4ef7-95db-edfd12ac0872 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:54.454612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 662/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:57.477825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe595d-f141-416b-97ea-a1c38605fe78 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:57.478376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe595d-f141-416b-97ea-a1c38605fe78 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:57.478376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe595d-f141-416b-97ea-a1c38605fe78 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:57.479731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 682/1344] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:57.484849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9175-9bdf-49ac-8553-2eb387f48670 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:57.485299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9175-9bdf-49ac-8553-2eb387f48670 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:57.485482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae9175-9bdf-49ac-8553-2eb387f48670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:57.513098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c0ae9175-9bdf-49ac-8553-2eb387f48670 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:57.514279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c0ae9175-9bdf-49ac-8553-2eb387f48670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:57.543130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:57.593511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 663/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:57.634856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe595d-f141-416b-97ea-a1c38605fe78 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:57.646560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe595d-f141-416b-97ea-a1c38605fe78 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:57.650143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544bc1d-574e-40bc-b5f6-d38ec30dca99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:57.650786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544bc1d-574e-40bc-b5f6-d38ec30dca99 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:57.651069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544bc1d-574e-40bc-b5f6-d38ec30dca99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:57.651346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544bc1d-574e-40bc-b5f6-d38ec30dca99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:57.661522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544bc1d-574e-40bc-b5f6-d38ec30dca99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:57.662970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544bc1d-574e-40bc-b5f6-d38ec30dca99 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:57.672570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 683/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:02.011956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e885-a119-485d-9078-6d3a64b2e442 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:02.013475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e885-a119-485d-9078-6d3a64b2e442 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:02.014098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e885-a119-485d-9078-6d3a64b2e442 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:02.017147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 664/1347] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:02.025593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76344e-f061-462c-a860-895449d540a5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:02.026360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76344e-f061-462c-a860-895449d540a5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:02.026776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76344e-f061-462c-a860-895449d540a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:02.048137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fa76344e-f061-462c-a860-895449d540a5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:02.049383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fa76344e-f061-462c-a860-895449d540a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:02.057450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 684/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:02.095398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e885-a119-485d-9078-6d3a64b2e442 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:02.107382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e885-a119-485d-9078-6d3a64b2e442 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:02.111047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838d6c5-7b54-4bcf-a88e-c46d4c9a26d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:02.111694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d6c5-7b54-4bcf-a88e-c46d4c9a26d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:02.111976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d6c5-7b54-4bcf-a88e-c46d4c9a26d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:02.112250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d6c5-7b54-4bcf-a88e-c46d4c9a26d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:02.122637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838d6c5-7b54-4bcf-a88e-c46d4c9a26d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:02.124093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838d6c5-7b54-4bcf-a88e-c46d4c9a26d1 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:02.136019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 665/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:07.153272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45167-0692-4dd8-85ec-4360c7f2a5d5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:07.153803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45167-0692-4dd8-85ec-4360c7f2a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:07.153803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45167-0692-4dd8-85ec-4360c7f2a5d5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:07.155207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 685/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:07.164529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738306-7fdd-4d10-91c5-4ec41e30bf0b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:07.165040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738306-7fdd-4d10-91c5-4ec41e30bf0b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:07.173517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738306-7fdd-4d10-91c5-4ec41e30bf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:07.289108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c0738306-7fdd-4d10-91c5-4ec41e30bf0b None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:07.290492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c0738306-7fdd-4d10-91c5-4ec41e30bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:07.369960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 666/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:47:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:11.490483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7ca6e-8a69-4e1e-8745-acf2de2f948d None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:11.491082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7ca6e-8a69-4e1e-8745-acf2de2f948d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:11.491082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7ca6e-8a69-4e1e-8745-acf2de2f948d None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:11.492631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 686/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:11.497685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc0de0-b296-4107-a5c8-74a66ac513ae None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:11.498161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc0de0-b296-4107-a5c8-74a66ac513ae None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:11.498261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc0de0-b296-4107-a5c8-74a66ac513ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:11.517806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-edbc0de0-b296-4107-a5c8-74a66ac513ae None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:11.519814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-edbc0de0-b296-4107-a5c8-74a66ac513ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:11.529360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 667/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:47:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:12.042898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=13 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:13.273395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01038b-cdb0-4adb-8a60-0850746113b7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:13.274019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01038b-cdb0-4adb-8a60-0850746113b7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:13.274019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01038b-cdb0-4adb-8a60-0850746113b7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:13.275302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 687/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:13.280278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8bb07-700e-4be0-a011-daef43da7d2a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:13.280671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8bb07-700e-4be0-a011-daef43da7d2a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:13.281249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8bb07-700e-4be0-a011-daef43da7d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:13.299474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-25e8bb07-700e-4be0-a011-daef43da7d2a None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:13.301765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-25e8bb07-700e-4be0-a011-daef43da7d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:13.310586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 668/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:47:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:47:16.821090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e001bf-995c-4b87-a1f2-3c906f899cd7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:16.821700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e001bf-995c-4b87-a1f2-3c906f899cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:16.821700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e001bf-995c-4b87-a1f2-3c906f899cd7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:16.823803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 688/1356] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:16.828608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0964-d93b-475c-a9d5-4ba649ea8849 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:16.829431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0964-d93b-475c-a9d5-4ba649ea8849 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:16.829882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b0964-d93b-475c-a9d5-4ba649ea8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:16.853601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6c8b0964-d93b-475c-a9d5-4ba649ea8849 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:16.854743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6c8b0964-d93b-475c-a9d5-4ba649ea8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:16.869457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 669/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:16.921928 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687ecb4-d233-477b-8ba9-43d64dc0e1f7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:16.922115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687ecb4-d233-477b-8ba9-43d64dc0e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:16.922365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687ecb4-d233-477b-8ba9-43d64dc0e1f7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:16.924137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 689/1358] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 5 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:16.933903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bcd04-8a95-499b-bf83-77e30467423a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:16.934316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bcd04-8a95-499b-bf83-77e30467423a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:16.934871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bcd04-8a95-499b-bf83-77e30467423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:16.983609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:16.993453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-299bcd04-8a95-499b-bf83-77e30467423a None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:16.994661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-299bcd04-8a95-499b-bf83-77e30467423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:17.092721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 670/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 5 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:47:17.094027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687ecb4-d233-477b-8ba9-43d64dc0e1f7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:17.119261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687ecb4-d233-477b-8ba9-43d64dc0e1f7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:17.125398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6872c-195f-4485-adb8-3898155a2cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:17.126320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6872c-195f-4485-adb8-3898155a2cb7 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:17.126608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6872c-195f-4485-adb8-3898155a2cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:17.126936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6872c-195f-4485-adb8-3898155a2cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:17.138156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6872c-195f-4485-adb8-3898155a2cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:17.139901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6872c-195f-4485-adb8-3898155a2cb7 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:17.150459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 690/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:19.421167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265877d7-2b43-45f0-8294-f3b354acf505 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:19.421717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265877d7-2b43-45f0-8294-f3b354acf505 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:19.421717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265877d7-2b43-45f0-8294-f3b354acf505 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:19.423083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 671/1361] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:19.429136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017597-9085-4e1e-93c8-9fb5cf7c2f05 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:19.429912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017597-9085-4e1e-93c8-9fb5cf7c2f05 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:19.430359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017597-9085-4e1e-93c8-9fb5cf7c2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:19.450296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-cc017597-9085-4e1e-93c8-9fb5cf7c2f05 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:19.451725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cc017597-9085-4e1e-93c8-9fb5cf7c2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:19.468886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 691/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:19.507451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265877d7-2b43-45f0-8294-f3b354acf505 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:19.522998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265877d7-2b43-45f0-8294-f3b354acf505 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:19.528863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f806bfe-3111-43b8-aa3d-e6d138638aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:19.529679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806bfe-3111-43b8-aa3d-e6d138638aeb service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:19.530052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806bfe-3111-43b8-aa3d-e6d138638aeb service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:19.530523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806bfe-3111-43b8-aa3d-e6d138638aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:19.540351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f806bfe-3111-43b8-aa3d-e6d138638aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:19.542171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f806bfe-3111-43b8-aa3d-e6d138638aeb service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:19.554948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 672/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:21.957588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d5e75-344f-40c6-96ef-d3bddd410da7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:21.958103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d5e75-344f-40c6-96ef-d3bddd410da7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:21.958103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d5e75-344f-40c6-96ef-d3bddd410da7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:21.959445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 692/1364] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:47:21.964502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfd0e1-e6cc-4e91-b35e-bc08e162a2cd None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:21.964899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfd0e1-e6cc-4e91-b35e-bc08e162a2cd None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:21.965090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfd0e1-e6cc-4e91-b35e-bc08e162a2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:21.990059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8bcfd0e1-e6cc-4e91-b35e-bc08e162a2cd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:21.991193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8bcfd0e1-e6cc-4e91-b35e-bc08e162a2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:22.001001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 673/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:22.048831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73811f-5d1b-400d-bf57-10558e68d940 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:22.049233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73811f-5d1b-400d-bf57-10558e68d940 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:22.049542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73811f-5d1b-400d-bf57-10558e68d940 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:22.051037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 693/1366] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 5 20:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:47:22.056448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1e01-a5c5-40b6-bfd8-9b5a60499324 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:22.056734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1e01-a5c5-40b6-bfd8-9b5a60499324 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:22.057053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1e01-a5c5-40b6-bfd8-9b5a60499324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:22.075177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1bca1e01-a5c5-40b6-bfd8-9b5a60499324 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:22.076430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1bca1e01-a5c5-40b6-bfd8-9b5a60499324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:22.086330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 674/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 5 20:47:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:22.094025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73811f-5d1b-400d-bf57-10558e68d940 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:22.109635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73811f-5d1b-400d-bf57-10558e68d940 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:22.115140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e7556-2a08-4470-a33c-244e26524285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:22.115836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e7556-2a08-4470-a33c-244e26524285 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:22.116184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e7556-2a08-4470-a33c-244e26524285 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:22.116527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e7556-2a08-4470-a33c-244e26524285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:22.124787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e7556-2a08-4470-a33c-244e26524285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:22.126458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e7556-2a08-4470-a33c-244e26524285 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:22.136088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 694/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:24.246754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2dfd-82c5-47d5-b44c-15cc2d060fbe None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:24.247638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2dfd-82c5-47d5-b44c-15cc2d060fbe None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:24.247919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2dfd-82c5-47d5-b44c-15cc2d060fbe None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:24.249502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 675/1369] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:24.255331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bf9c3-ec06-4e75-9fd2-04185a2749ce None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:24.255746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bf9c3-ec06-4e75-9fd2-04185a2749ce None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:24.255890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bf9c3-ec06-4e75-9fd2-04185a2749ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:24.274205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f63bf9c3-ec06-4e75-9fd2-04185a2749ce None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:24.275705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f63bf9c3-ec06-4e75-9fd2-04185a2749ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:24.284916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 695/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:24.331738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2dfd-82c5-47d5-b44c-15cc2d060fbe None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:24.346416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a2dfd-82c5-47d5-b44c-15cc2d060fbe None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:24.352207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a7b81-6e48-4e6d-a74b-8e1455fc515c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:24.352855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7b81-6e48-4e6d-a74b-8e1455fc515c service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:24.353178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7b81-6e48-4e6d-a74b-8e1455fc515c service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:24.353455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a7b81-6e48-4e6d-a74b-8e1455fc515c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:24.362758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7b81-6e48-4e6d-a74b-8e1455fc515c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:24.364344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a7b81-6e48-4e6d-a74b-8e1455fc515c service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:24.374884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 676/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:25.044554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3db5-4d1c-4e40-bd38-bfc90db56ba5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:25.045534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3db5-4d1c-4e40-bd38-bfc90db56ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:25.046095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3db5-4d1c-4e40-bd38-bfc90db56ba5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:25.047648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 696/1372] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:25.053513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36189ce-b626-4dab-8c61-16a08846c371 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:25.053808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36189ce-b626-4dab-8c61-16a08846c371 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:25.054092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36189ce-b626-4dab-8c61-16a08846c371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:25.072698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b36189ce-b626-4dab-8c61-16a08846c371 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:25.073931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b36189ce-b626-4dab-8c61-16a08846c371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:25.083197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 677/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:25.424164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85b01-c222-4b8c-be12-908a8928f5f5 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:25.425421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85b01-c222-4b8c-be12-908a8928f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:25.425421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f85b01-c222-4b8c-be12-908a8928f5f5 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:25.426881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 697/1374] 10.222.0.20 () {54 vars in 963 bytes} [Tue Jul 5 20:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:25.432412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37209ed9-cc01-4294-af9a-a22dbfebcfa4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:25.433783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37209ed9-cc01-4294-af9a-a22dbfebcfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:25.434715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37209ed9-cc01-4294-af9a-a22dbfebcfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:25.486053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-37209ed9-cc01-4294-af9a-a22dbfebcfa4 None None] MFA Rules not processed for user `04a4d556adeb43139a65f61af0076091`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:25.488065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-37209ed9-cc01-4294-af9a-a22dbfebcfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:25.554325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 678/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Tue Jul 5 20:47:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:25.562168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85b01-c222-4b8c-be12-908a8928f5f5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:25.573240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f85b01-c222-4b8c-be12-908a8928f5f5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:25.576893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af748341-d96b-4ff7-9fbc-c071bcdc3c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:25.577705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748341-d96b-4ff7-9fbc-c071bcdc3c59 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:25.578092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748341-d96b-4ff7-9fbc-c071bcdc3c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:25.578474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748341-d96b-4ff7-9fbc-c071bcdc3c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:25.588748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af748341-d96b-4ff7-9fbc-c071bcdc3c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:25.590525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af748341-d96b-4ff7-9fbc-c071bcdc3c59 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:25.603225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 698/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:26.482033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc7569-644e-43b7-8b29-79e9ac7bc562 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:26.482577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc7569-644e-43b7-8b29-79e9ac7bc562 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:26.482577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc7569-644e-43b7-8b29-79e9ac7bc562 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:26.483967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 679/1377] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:26.489844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1bef-f0dd-4b32-a0dd-09c2a6c4af8b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:26.490257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1bef-f0dd-4b32-a0dd-09c2a6c4af8b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:26.490405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1bef-f0dd-4b32-a0dd-09c2a6c4af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:26.509498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-916c1bef-f0dd-4b32-a0dd-09c2a6c4af8b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:26.510775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-916c1bef-f0dd-4b32-a0dd-09c2a6c4af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:26.519454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 699/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:26.563418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc7569-644e-43b7-8b29-79e9ac7bc562 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:26.578338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc7569-644e-43b7-8b29-79e9ac7bc562 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:26.583930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc4173-1a54-4bf1-8ae2-d3302aca028c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:26.584766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc4173-1a54-4bf1-8ae2-d3302aca028c service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:26.585158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc4173-1a54-4bf1-8ae2-d3302aca028c service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:26.585559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc4173-1a54-4bf1-8ae2-d3302aca028c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:26.594804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc4173-1a54-4bf1-8ae2-d3302aca028c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:26.596418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc4173-1a54-4bf1-8ae2-d3302aca028c service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:26.600344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:26.607168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 680/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:28.688946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6956d-8772-4a85-a24e-627a5db6b923 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:28.689472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6956d-8772-4a85-a24e-627a5db6b923 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:28.689472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6956d-8772-4a85-a24e-627a5db6b923 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:28.691656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 700/1380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:47:28.698445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b525d9-66af-4b8e-8a37-f9c6eea63056 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:28.698864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b525d9-66af-4b8e-8a37-f9c6eea63056 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:28.698982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b525d9-66af-4b8e-8a37-f9c6eea63056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:28.717783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a2b525d9-66af-4b8e-8a37-f9c6eea63056 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:28.718968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a2b525d9-66af-4b8e-8a37-f9c6eea63056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:28.726945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 681/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:28.771165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6956d-8772-4a85-a24e-627a5db6b923 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:28.786817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6956d-8772-4a85-a24e-627a5db6b923 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:28.792589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078df84-1208-4d87-8d48-4d19dcaf184f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:28.793263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078df84-1208-4d87-8d48-4d19dcaf184f service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:28.793550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078df84-1208-4d87-8d48-4d19dcaf184f service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:28.793830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078df84-1208-4d87-8d48-4d19dcaf184f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:28.803584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078df84-1208-4d87-8d48-4d19dcaf184f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:28.805238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078df84-1208-4d87-8d48-4d19dcaf184f service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:28.814630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 701/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:30.929069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0a10-7136-49a2-8b49-1ceab72c77c2 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:30.929631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0a10-7136-49a2-8b49-1ceab72c77c2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:30.929631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0a10-7136-49a2-8b49-1ceab72c77c2 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:30.930988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 682/1383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:30.936014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555ec7-8869-4ee9-8fb6-3a265afab328 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:30.936421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555ec7-8869-4ee9-8fb6-3a265afab328 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:30.936575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555ec7-8869-4ee9-8fb6-3a265afab328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:30.955164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-91555ec7-8869-4ee9-8fb6-3a265afab328 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:30.956635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-91555ec7-8869-4ee9-8fb6-3a265afab328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:30.964560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 702/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:31.007030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0a10-7136-49a2-8b49-1ceab72c77c2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:31.023195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0a10-7136-49a2-8b49-1ceab72c77c2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:31.028816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de6f6a-7c09-4fbd-af77-65d8be13bc08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:31.029495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6f6a-7c09-4fbd-af77-65d8be13bc08 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:31.029776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6f6a-7c09-4fbd-af77-65d8be13bc08 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:31.030051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de6f6a-7c09-4fbd-af77-65d8be13bc08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:31.040352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de6f6a-7c09-4fbd-af77-65d8be13bc08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:31.041961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de6f6a-7c09-4fbd-af77-65d8be13bc08 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:31.051867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 683/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:33.099769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e466-8fc6-47d0-ac89-603afb5d55a8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:33.100265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e466-8fc6-47d0-ac89-603afb5d55a8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:33.100801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e466-8fc6-47d0-ac89-603afb5d55a8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:33.102239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 703/1386] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:33.108492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6827-0595-4663-b290-b0c9ae7ee2ee None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:33.108915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6827-0595-4663-b290-b0c9ae7ee2ee None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:33.109202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6827-0595-4663-b290-b0c9ae7ee2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:33.140069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-58bc6827-0595-4663-b290-b0c9ae7ee2ee None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:33.141156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-58bc6827-0595-4663-b290-b0c9ae7ee2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:33.157069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 684/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:47:33.199013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e466-8fc6-47d0-ac89-603afb5d55a8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:33.215087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e466-8fc6-47d0-ac89-603afb5d55a8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:33.220761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f72ad-0aba-4895-87aa-25ee57b58ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:33.221437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f72ad-0aba-4895-87aa-25ee57b58ee5 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:33.221720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f72ad-0aba-4895-87aa-25ee57b58ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:33.222004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f72ad-0aba-4895-87aa-25ee57b58ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:33.230393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f72ad-0aba-4895-87aa-25ee57b58ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:33.231982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f72ad-0aba-4895-87aa-25ee57b58ee5 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:33.242566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 704/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:35.375214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571627-7edd-4a99-8a17-e05123a7f46d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:35.377904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571627-7edd-4a99-8a17-e05123a7f46d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:35.377904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571627-7edd-4a99-8a17-e05123a7f46d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:35.377904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 685/1389] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:35.382875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1b6e-26ed-41e4-8ef7-c5034a3a9e1e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:35.383375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1b6e-26ed-41e4-8ef7-c5034a3a9e1e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:35.383535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1b6e-26ed-41e4-8ef7-c5034a3a9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:35.401789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-962b1b6e-26ed-41e4-8ef7-c5034a3a9e1e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:35.402981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-962b1b6e-26ed-41e4-8ef7-c5034a3a9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:35.412350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 705/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:35.458829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571627-7edd-4a99-8a17-e05123a7f46d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:35.473407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571627-7edd-4a99-8a17-e05123a7f46d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:35.478981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc4f54-430b-4f27-bfbe-6652e4650375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:35.479573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc4f54-430b-4f27-bfbe-6652e4650375 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:35.479859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc4f54-430b-4f27-bfbe-6652e4650375 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:35.480140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc4f54-430b-4f27-bfbe-6652e4650375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:35.489773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc4f54-430b-4f27-bfbe-6652e4650375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:35.491371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc4f54-430b-4f27-bfbe-6652e4650375 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:35.500969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 686/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:37.669814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b9fee-e70e-42a0-a4e8-dd6acdf8a135 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:37.670372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b9fee-e70e-42a0-a4e8-dd6acdf8a135 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:37.670372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b9fee-e70e-42a0-a4e8-dd6acdf8a135 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:37.671737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 706/1392] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:37.678087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e278-538c-4eb1-b20d-46cac287175b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:37.678573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e278-538c-4eb1-b20d-46cac287175b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:37.678684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6e278-538c-4eb1-b20d-46cac287175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:37.701118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8fc6e278-538c-4eb1-b20d-46cac287175b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:37.702978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8fc6e278-538c-4eb1-b20d-46cac287175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:37.713328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 687/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:37.768526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b9fee-e70e-42a0-a4e8-dd6acdf8a135 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:37.784524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b9fee-e70e-42a0-a4e8-dd6acdf8a135 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:37.790198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac73f-6775-455b-b6ec-19341dfaf25e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:37.790852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac73f-6775-455b-b6ec-19341dfaf25e service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:37.791136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac73f-6775-455b-b6ec-19341dfaf25e service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:37.791413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac73f-6775-455b-b6ec-19341dfaf25e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:37.800182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ac73f-6775-455b-b6ec-19341dfaf25e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:37.801826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ac73f-6775-455b-b6ec-19341dfaf25e service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:37.811529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 707/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:39.949841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e53ff-c49a-45e1-b755-e2ce547c5134 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:39.950371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e53ff-c49a-45e1-b755-e2ce547c5134 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:39.950487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e53ff-c49a-45e1-b755-e2ce547c5134 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:39.951911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 688/1395] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:39.958206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907a81-1a78-4746-b2d8-e64a43effa51 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:39.958657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907a81-1a78-4746-b2d8-e64a43effa51 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:39.958800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907a81-1a78-4746-b2d8-e64a43effa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:39.980874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-91907a81-1a78-4746-b2d8-e64a43effa51 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:39.982151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-91907a81-1a78-4746-b2d8-e64a43effa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:39.991462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 708/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:40.036328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e53ff-c49a-45e1-b755-e2ce547c5134 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:40.050998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e53ff-c49a-45e1-b755-e2ce547c5134 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:40.056366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7669-1884-4180-bee6-fbf5b560a0bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:40.057039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7669-1884-4180-bee6-fbf5b560a0bc service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:40.057323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7669-1884-4180-bee6-fbf5b560a0bc service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:40.057589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7669-1884-4180-bee6-fbf5b560a0bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:40.066374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7669-1884-4180-bee6-fbf5b560a0bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:40.067952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7669-1884-4180-bee6-fbf5b560a0bc service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:40.077444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 689/1397] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:40.920014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5037f-af3f-4398-9e8c-a801b4cafdb7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:40.920323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5037f-af3f-4398-9e8c-a801b4cafdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:40.920605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5037f-af3f-4398-9e8c-a801b4cafdb7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:40.922063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 709/1398] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:40.928032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13227-59b9-4b9d-89c4-b4a0e5afb8b4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:40.928324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13227-59b9-4b9d-89c4-b4a0e5afb8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:40.928605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b13227-59b9-4b9d-89c4-b4a0e5afb8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:40.946531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-04b13227-59b9-4b9d-89c4-b4a0e5afb8b4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:40.947713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-04b13227-59b9-4b9d-89c4-b4a0e5afb8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:40.956433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 690/1399] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:41.011929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f50a-2c2f-41af-9737-9057836ec5e0 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:41.012395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f50a-2c2f-41af-9737-9057836ec5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:41.012490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f50a-2c2f-41af-9737-9057836ec5e0 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:41.013908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 710/1400] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 5 20:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:41.019885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be5d3b-620a-4a3d-9ffb-47defbc70dcf None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:41.020126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be5d3b-620a-4a3d-9ffb-47defbc70dcf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:41.020302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be5d3b-620a-4a3d-9ffb-47defbc70dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:41.068729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-99be5d3b-620a-4a3d-9ffb-47defbc70dcf None None] MFA Rules not processed for user `dbd8ecdcc21f4d22b969036c1d7a3672`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:41.069932 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-99be5d3b-620a-4a3d-9ffb-47defbc70dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:41.128864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 691/1401] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 5 20:47:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:41.136305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f50a-2c2f-41af-9737-9057836ec5e0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:41.147696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f50a-2c2f-41af-9737-9057836ec5e0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:41.151306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438439-249c-4f99-98b9-f3002c22e1de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:41.152010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438439-249c-4f99-98b9-f3002c22e1de service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:41.152362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438439-249c-4f99-98b9-f3002c22e1de service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:41.152728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438439-249c-4f99-98b9-f3002c22e1de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:41.162334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438439-249c-4f99-98b9-f3002c22e1de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:41.163842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438439-249c-4f99-98b9-f3002c22e1de service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:41.173363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 711/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:41.904164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fe40-f2a2-4a19-b5d7-02039a451060 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:41.904453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fe40-f2a2-4a19-b5d7-02039a451060 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:41.904727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55fe40-f2a2-4a19-b5d7-02039a451060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:41.953939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ae55fe40-f2a2-4a19-b5d7-02039a451060 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:41.955762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ae55fe40-f2a2-4a19-b5d7-02039a451060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:41.995304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:42.020195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 692/1403] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:47:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:42.059662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c650-e1c1-45fe-a2f8-5d2282602ff4 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:42.060168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c650-e1c1-45fe-a2f8-5d2282602ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:42.060335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563c650-e1c1-45fe-a2f8-5d2282602ff4 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:42.061651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 712/1404] 10.222.0.20 () {54 vars in 942 bytes} [Tue Jul 5 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:42.069162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:42.069521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:42.069864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:42.120166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] MFA Rules not processed for user `56392bbbf8e449cfbcdddd6a492444bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:42.121462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:42.174658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a2b3-7fd1-497f-92ea-697d12f4e4fb None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:42.174846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a2b3-7fd1-497f-92ea-697d12f4e4fb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:42.175135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781a2b3-7fd1-497f-92ea-697d12f4e4fb None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:42.176508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 713/1405] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:47:42.181427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:42.181716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:42.181998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:42.188376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=61 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:42.194496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 693/1406] 10.222.0.20 () {58 vars in 1039 bytes} [Tue Jul 5 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:42.202091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:42.203389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:42.203666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:42.212351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 714/1407] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:47:42.214164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da948559-0e7b-4795-ac6b-4c60eef91359 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:42.219127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee533038-7688-4e22-8564-32a002f07b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:42.219757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533038-7688-4e22-8564-32a002f07b0f service swift] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:42.220037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533038-7688-4e22-8564-32a002f07b0f service swift] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:42.220304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533038-7688-4e22-8564-32a002f07b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:42.228460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533038-7688-4e22-8564-32a002f07b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:42.230076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533038-7688-4e22-8564-32a002f07b0f service swift] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:42.238418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 694/1408] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:47:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:47:42.257993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:42.270932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ce05c-9792-4f31-880b-914e7b3f0b62 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:42.276891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4b933-4bb9-45fb-8b52-23ee53b76ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:42.277587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4b933-4bb9-45fb-8b52-23ee53b76ddc service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:42.277996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4b933-4bb9-45fb-8b52-23ee53b76ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:42.278281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4b933-4bb9-45fb-8b52-23ee53b76ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:42.287516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4b933-4bb9-45fb-8b52-23ee53b76ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:42.289319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4b933-4bb9-45fb-8b52-23ee53b76ddc service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:42.300220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 715/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:52.234786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=59 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:52.294815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=8 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:04.558095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317396-c538-4ed3-806f-3842634c9ed5 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:04.558656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317396-c538-4ed3-806f-3842634c9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:04.558656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317396-c538-4ed3-806f-3842634c9ed5 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:04.560112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 695/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jul 5 20:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:04.565253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751b3e1-f63a-4d68-a7c9-901073a64db7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:04.565696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751b3e1-f63a-4d68-a7c9-901073a64db7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:04.565808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751b3e1-f63a-4d68-a7c9-901073a64db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:04.583132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7751b3e1-f63a-4d68-a7c9-901073a64db7 None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:04.584309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7751b3e1-f63a-4d68-a7c9-901073a64db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:04.592633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 716/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 5 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:04.606887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8749e-bd17-4b92-ae8d-5eb5af9bfe17 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:04.607188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8749e-bd17-4b92-ae8d-5eb5af9bfe17 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:04.607467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8749e-bd17-4b92-ae8d-5eb5af9bfe17 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:04.608818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 696/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jul 5 20:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:04.613962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210e402-79b9-4b38-98f3-03c25c244778 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:04.614246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210e402-79b9-4b38-98f3-03c25c244778 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:04.614521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210e402-79b9-4b38-98f3-03c25c244778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:04.632073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9210e402-79b9-4b38-98f3-03c25c244778 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:04.633277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9210e402-79b9-4b38-98f3-03c25c244778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:04.643141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 717/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 5 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:07.145399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f99397-d903-4082-b4d9-6917940754c5 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:07.145983 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f99397-d903-4082-b4d9-6917940754c5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:07.145983 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f99397-d903-4082-b4d9-6917940754c5 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:07.147367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:07.152528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54da9e-afcd-440c-8263-9a12d17002e7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:07.153002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54da9e-afcd-440c-8263-9a12d17002e7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:07.153103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54da9e-afcd-440c-8263-9a12d17002e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:07.170384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2c54da9e-afcd-440c-8263-9a12d17002e7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:07.171565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2c54da9e-afcd-440c-8263-9a12d17002e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:07.179843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:07.222769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f99397-d903-4082-b4d9-6917940754c5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:07.242222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f99397-d903-4082-b4d9-6917940754c5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:07.247673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f569182-0fb0-49a2-aedd-49fc38c200bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:07.248312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f569182-0fb0-49a2-aedd-49fc38c200bc service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:07.248595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f569182-0fb0-49a2-aedd-49fc38c200bc service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:07.248870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f569182-0fb0-49a2-aedd-49fc38c200bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:07.257867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f569182-0fb0-49a2-aedd-49fc38c200bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:07.259430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f569182-0fb0-49a2-aedd-49fc38c200bc service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:07.268825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 698/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:08.173716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872761de-639f-460d-9489-66c3201b4a08 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:08.174296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872761de-639f-460d-9489-66c3201b4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:08.174296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872761de-639f-460d-9489-66c3201b4a08 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:08.175664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:08.180647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49236f-b747-4f03-9469-b72339909aaa None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:08.181093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49236f-b747-4f03-9469-b72339909aaa None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:08.181250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49236f-b747-4f03-9469-b72339909aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:08.198770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9c49236f-b747-4f03-9469-b72339909aaa None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:08.199940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9c49236f-b747-4f03-9469-b72339909aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:08.207756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:08.356977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872761de-639f-460d-9489-66c3201b4a08 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:08.371887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872761de-639f-460d-9489-66c3201b4a08 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:08.377434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fe4bd-6a54-46fe-abf2-408162a2b759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:08.378077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe4bd-6a54-46fe-abf2-408162a2b759 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:08.378364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe4bd-6a54-46fe-abf2-408162a2b759 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:08.378645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe4bd-6a54-46fe-abf2-408162a2b759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:08.386901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fe4bd-6a54-46fe-abf2-408162a2b759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:08.388486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5fe4bd-6a54-46fe-abf2-408162a2b759 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:08.398002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 720/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:09.286373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32eb1f-3f8f-4ac0-9731-c3b4fbea5e5b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:09.286922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32eb1f-3f8f-4ac0-9731-c3b4fbea5e5b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:09.286922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32eb1f-3f8f-4ac0-9731-c3b4fbea5e5b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:09.288337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:09.293309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c09f3-675e-4c14-9cdd-4f76820cf962 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:09.293719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c09f3-675e-4c14-9cdd-4f76820cf962 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:09.293876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c09f3-675e-4c14-9cdd-4f76820cf962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:09.311352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-970c09f3-675e-4c14-9cdd-4f76820cf962 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:09.312547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-970c09f3-675e-4c14-9cdd-4f76820cf962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:09.320420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:09.471456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32eb1f-3f8f-4ac0-9731-c3b4fbea5e5b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:09.486411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32eb1f-3f8f-4ac0-9731-c3b4fbea5e5b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:09.491834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1a77-2650-4731-a69f-bcbb3ce09262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:09.492464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1a77-2650-4731-a69f-bcbb3ce09262 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:09.492744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1a77-2650-4731-a69f-bcbb3ce09262 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:09.493050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1a77-2650-4731-a69f-bcbb3ce09262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:09.501724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1a77-2650-4731-a69f-bcbb3ce09262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:09.503588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1a77-2650-4731-a69f-bcbb3ce09262 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:09.512753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 701/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:10.371529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98041-bc55-48ca-b213-d67b4ac6802e None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:10.372080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98041-bc55-48ca-b213-d67b4ac6802e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:10.372080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98041-bc55-48ca-b213-d67b4ac6802e None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:10.373481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:10.379058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8c45-1231-45c0-a2d3-115911136672 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:10.379486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8c45-1231-45c0-a2d3-115911136672 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:10.379590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8c45-1231-45c0-a2d3-115911136672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:10.397135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-301d8c45-1231-45c0-a2d3-115911136672 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:10.398305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-301d8c45-1231-45c0-a2d3-115911136672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:10.406946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:10.557632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98041-bc55-48ca-b213-d67b4ac6802e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:10.572041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98041-bc55-48ca-b213-d67b4ac6802e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:10.577327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eea9f-f243-4be1-8908-312a5c4060cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:10.577955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eea9f-f243-4be1-8908-312a5c4060cd service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:10.578238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eea9f-f243-4be1-8908-312a5c4060cd service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:10.578512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eea9f-f243-4be1-8908-312a5c4060cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:10.586729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eea9f-f243-4be1-8908-312a5c4060cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:10.588294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eea9f-f243-4be1-8908-312a5c4060cd service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:10.598565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 723/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:11.460900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c5df0-9a44-4c7e-9172-5bad0033655d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:11.461470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c5df0-9a44-4c7e-9172-5bad0033655d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:11.461570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c5df0-9a44-4c7e-9172-5bad0033655d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:11.462907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:11.467752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf6278-69c4-476f-b169-4269c5c1454e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:11.468159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf6278-69c4-476f-b169-4269c5c1454e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:11.468312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf6278-69c4-476f-b169-4269c5c1454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:11.487296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4fbf6278-69c4-476f-b169-4269c5c1454e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:11.488496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4fbf6278-69c4-476f-b169-4269c5c1454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:11.496397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:11.646578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c5df0-9a44-4c7e-9172-5bad0033655d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:11.661358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c5df0-9a44-4c7e-9172-5bad0033655d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:11.666618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74174-b061-4940-a014-6bda57475a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:11.667246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74174-b061-4940-a014-6bda57475a6a service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:11.667527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74174-b061-4940-a014-6bda57475a6a service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:11.667803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74174-b061-4940-a014-6bda57475a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:11.675818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74174-b061-4940-a014-6bda57475a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:11.677428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74174-b061-4940-a014-6bda57475a6a service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:11.686718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 704/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:12.486546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2df0ef-2529-411c-bfc9-839dd5e870f8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:12.486995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2df0ef-2529-411c-bfc9-839dd5e870f8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:12.487111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2df0ef-2529-411c-bfc9-839dd5e870f8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:12.488457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:12.493480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5101-032d-4479-a961-8e4e5cce2419 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:12.493948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5101-032d-4479-a961-8e4e5cce2419 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:12.494050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5101-032d-4479-a961-8e4e5cce2419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:12.511999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b21f5101-032d-4479-a961-8e4e5cce2419 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:12.513213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b21f5101-032d-4479-a961-8e4e5cce2419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:12.521058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:12.668987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2df0ef-2529-411c-bfc9-839dd5e870f8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:12.683983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2df0ef-2529-411c-bfc9-839dd5e870f8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:12.689494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f0600-273e-4e9e-8372-1c7be693816d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:12.690132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0600-273e-4e9e-8372-1c7be693816d service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:12.690415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0600-273e-4e9e-8372-1c7be693816d service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:12.690690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f0600-273e-4e9e-8372-1c7be693816d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:12.698807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f0600-273e-4e9e-8372-1c7be693816d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:12.700387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f0600-273e-4e9e-8372-1c7be693816d service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:12.710439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 726/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:13.521571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5756a6-719e-401f-b9e0-eb01c9b21f13 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:13.522152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5756a6-719e-401f-b9e0-eb01c9b21f13 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:13.522152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5756a6-719e-401f-b9e0-eb01c9b21f13 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:13.523490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:13.528325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420f9a-4ecf-4cfa-a450-32e8fbcd72ad None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:13.528811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420f9a-4ecf-4cfa-a450-32e8fbcd72ad None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:13.528918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c420f9a-4ecf-4cfa-a450-32e8fbcd72ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:13.547152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0c420f9a-4ecf-4cfa-a450-32e8fbcd72ad None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:13.549036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0c420f9a-4ecf-4cfa-a450-32e8fbcd72ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:13.556639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:13.708122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5756a6-719e-401f-b9e0-eb01c9b21f13 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:13.723432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5756a6-719e-401f-b9e0-eb01c9b21f13 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:13.728818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea0b8c-9a4f-4664-96a0-fb6773a5f174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:13.729489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea0b8c-9a4f-4664-96a0-fb6773a5f174 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:13.729775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea0b8c-9a4f-4664-96a0-fb6773a5f174 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:13.730054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea0b8c-9a4f-4664-96a0-fb6773a5f174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:13.739733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea0b8c-9a4f-4664-96a0-fb6773a5f174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:13.741371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea0b8c-9a4f-4664-96a0-fb6773a5f174 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:13.750736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 707/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:14.551742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a595a-00d5-4a54-aacc-0619dde4e63b None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:14.552307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a595a-00d5-4a54-aacc-0619dde4e63b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:14.552307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a595a-00d5-4a54-aacc-0619dde4e63b None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:14.553690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:14.558590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f098-d05c-4cfa-a705-35a5141e764e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:14.559005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f098-d05c-4cfa-a705-35a5141e764e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:14.559147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f098-d05c-4cfa-a705-35a5141e764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:14.578013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1fc0f098-d05c-4cfa-a705-35a5141e764e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:14.579777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1fc0f098-d05c-4cfa-a705-35a5141e764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:14.587590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:14.743209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a595a-00d5-4a54-aacc-0619dde4e63b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:14.757416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a595a-00d5-4a54-aacc-0619dde4e63b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:14.763059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b7cad-73d2-4463-bbf7-0d1c67b83f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:14.763698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7cad-73d2-4463-bbf7-0d1c67b83f0c service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:14.763961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7cad-73d2-4463-bbf7-0d1c67b83f0c service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:14.764240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7cad-73d2-4463-bbf7-0d1c67b83f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:14.773472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b7cad-73d2-4463-bbf7-0d1c67b83f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:14.775054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b7cad-73d2-4463-bbf7-0d1c67b83f0c service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:14.785537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 729/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:15.608479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cadde-9243-49cb-881e-be7fb75adcd4 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:15.609080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cadde-9243-49cb-881e-be7fb75adcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:15.609080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cadde-9243-49cb-881e-be7fb75adcd4 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:15.610963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:15.615885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6efc8-74a1-49eb-b0e9-6fe14eb3c297 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:15.616322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6efc8-74a1-49eb-b0e9-6fe14eb3c297 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:15.616437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6efc8-74a1-49eb-b0e9-6fe14eb3c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:15.634788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-35a6efc8-74a1-49eb-b0e9-6fe14eb3c297 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:15.636236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-35a6efc8-74a1-49eb-b0e9-6fe14eb3c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:15.644544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:15.800885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cadde-9243-49cb-881e-be7fb75adcd4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:15.815380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cadde-9243-49cb-881e-be7fb75adcd4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:15.820777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51db83a-34ef-439d-9a3a-92ae5bf94fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:15.821449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db83a-34ef-439d-9a3a-92ae5bf94fee service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:15.821734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db83a-34ef-439d-9a3a-92ae5bf94fee service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:15.822011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51db83a-34ef-439d-9a3a-92ae5bf94fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:15.830135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db83a-34ef-439d-9a3a-92ae5bf94fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:15.831707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51db83a-34ef-439d-9a3a-92ae5bf94fee service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:15.841067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 710/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:17.790528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc34cb-bebb-4468-bfba-8a952669a757 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:17.791091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc34cb-bebb-4468-bfba-8a952669a757 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:17.791091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc34cb-bebb-4468-bfba-8a952669a757 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:17.792496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:17.797605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7592-1612-4083-ab5f-77263a425fa2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:17.798158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7592-1612-4083-ab5f-77263a425fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:17.798401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7592-1612-4083-ab5f-77263a425fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:17.815745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b49e7592-1612-4083-ab5f-77263a425fa2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:17.816948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b49e7592-1612-4083-ab5f-77263a425fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:17.824946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:17.864336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc34cb-bebb-4468-bfba-8a952669a757 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:17.875085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc34cb-bebb-4468-bfba-8a952669a757 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:17.879308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ff740-e404-4cd1-a8ab-5d2fda2e9fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:17.879943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff740-e404-4cd1-a8ab-5d2fda2e9fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:17.880229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff740-e404-4cd1-a8ab-5d2fda2e9fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:17.880509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff740-e404-4cd1-a8ab-5d2fda2e9fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:17.889645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ff740-e404-4cd1-a8ab-5d2fda2e9fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:17.891066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ff740-e404-4cd1-a8ab-5d2fda2e9fbc service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:17.900488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 732/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:20.062096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753c78-3775-4e19-be7d-88fa6ab3e0d2 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:20.062656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753c78-3775-4e19-be7d-88fa6ab3e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:20.062656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc753c78-3775-4e19-be7d-88fa6ab3e0d2 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:20.064156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:20.069504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129995-37c4-441f-987d-198b2ed31c11 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:20.069956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129995-37c4-441f-987d-198b2ed31c11 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:20.070075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129995-37c4-441f-987d-198b2ed31c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:20.087765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a6129995-37c4-441f-987d-198b2ed31c11 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:20.088961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a6129995-37c4-441f-987d-198b2ed31c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:20.097257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:20.135591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753c78-3775-4e19-be7d-88fa6ab3e0d2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:20.137272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-dc753c78-3775-4e19-be7d-88fa6ab3e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:20.150545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc753c78-3775-4e19-be7d-88fa6ab3e0d2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:20.154026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67c9b4-f6be-43df-9de8-04642ac9828f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:20.154656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67c9b4-f6be-43df-9de8-04642ac9828f service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:20.154930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67c9b4-f6be-43df-9de8-04642ac9828f service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:20.155200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67c9b4-f6be-43df-9de8-04642ac9828f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:20.164282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67c9b4-f6be-43df-9de8-04642ac9828f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:20.165723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67c9b4-f6be-43df-9de8-04642ac9828f service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:20.174994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 713/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:22.592757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431351b-f682-4a1b-846d-8b03f92576df None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:22.593367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431351b-f682-4a1b-846d-8b03f92576df None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:22.593367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431351b-f682-4a1b-846d-8b03f92576df None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:22.595345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:22.600801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9eaa-8f99-407b-9ced-a9915f2fe265 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:22.601286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9eaa-8f99-407b-9ced-a9915f2fe265 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:22.601463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9eaa-8f99-407b-9ced-a9915f2fe265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:22.619834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-179a9eaa-8f99-407b-9ced-a9915f2fe265 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:22.621064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-179a9eaa-8f99-407b-9ced-a9915f2fe265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:22.634012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:22.673124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431351b-f682-4a1b-846d-8b03f92576df None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:22.683921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431351b-f682-4a1b-846d-8b03f92576df None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:22.687507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367aa20-2138-4984-8350-cc37681b60f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:22.688173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367aa20-2138-4984-8350-cc37681b60f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:22.689015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367aa20-2138-4984-8350-cc37681b60f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:22.689300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367aa20-2138-4984-8350-cc37681b60f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:22.698260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367aa20-2138-4984-8350-cc37681b60f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:22.699691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367aa20-2138-4984-8350-cc37681b60f0 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:22.709854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 735/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:24.899385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bd15-7b42-492d-8b7c-8870394cb661 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:24.899948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bd15-7b42-492d-8b7c-8870394cb661 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:24.899948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bd15-7b42-492d-8b7c-8870394cb661 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:24.901402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:24.906960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958c6c-0dc5-470b-a808-e32b948a757d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:24.907452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958c6c-0dc5-470b-a808-e32b948a757d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:24.907780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3958c6c-0dc5-470b-a808-e32b948a757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:24.925490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a3958c6c-0dc5-470b-a808-e32b948a757d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:24.926688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a3958c6c-0dc5-470b-a808-e32b948a757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:24.934650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:24.972810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bd15-7b42-492d-8b7c-8870394cb661 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:24.983551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bd15-7b42-492d-8b7c-8870394cb661 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:24.987698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016dc2d-1d5a-44c8-8030-12515c4047b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:24.988330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016dc2d-1d5a-44c8-8030-12515c4047b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:24.988613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016dc2d-1d5a-44c8-8030-12515c4047b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:24.988889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016dc2d-1d5a-44c8-8030-12515c4047b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:24.997748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016dc2d-1d5a-44c8-8030-12515c4047b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:24.999180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016dc2d-1d5a-44c8-8030-12515c4047b4 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:25.009425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 716/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:27.124671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e701f-a440-4730-8fb7-1ad53cb0a6d3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:27.125251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e701f-a440-4730-8fb7-1ad53cb0a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:27.125251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e701f-a440-4730-8fb7-1ad53cb0a6d3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:27.127614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:48:27.133182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4056b-700f-47c4-90c8-8e723100de7f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:27.133612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4056b-700f-47c4-90c8-8e723100de7f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:27.133720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4056b-700f-47c4-90c8-8e723100de7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:27.151696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5dc4056b-700f-47c4-90c8-8e723100de7f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:27.152904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5dc4056b-700f-47c4-90c8-8e723100de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:27.160982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:27.198849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e701f-a440-4730-8fb7-1ad53cb0a6d3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:27.210567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e701f-a440-4730-8fb7-1ad53cb0a6d3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:27.214106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20a13-895d-40f1-8582-3cf9e7173af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:27.214742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20a13-895d-40f1-8582-3cf9e7173af4 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:27.215029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20a13-895d-40f1-8582-3cf9e7173af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:27.215312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20a13-895d-40f1-8582-3cf9e7173af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:27.224378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb20a13-895d-40f1-8582-3cf9e7173af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:27.225850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb20a13-895d-40f1-8582-3cf9e7173af4 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:27.235884 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 738/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:29.343321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f8d3-498d-4813-a5f7-5c9b6a2f549a None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:29.343919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f8d3-498d-4813-a5f7-5c9b6a2f549a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:29.343919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f8d3-498d-4813-a5f7-5c9b6a2f549a None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:29.345807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:29.351127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a219a-cd3f-4fdc-89ec-f80f7198b2bc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:29.351581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a219a-cd3f-4fdc-89ec-f80f7198b2bc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:29.351692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a219a-cd3f-4fdc-89ec-f80f7198b2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:29.369954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b22a219a-cd3f-4fdc-89ec-f80f7198b2bc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:29.371144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b22a219a-cd3f-4fdc-89ec-f80f7198b2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:29.379325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:29.417839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f8d3-498d-4813-a5f7-5c9b6a2f549a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:29.429162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f8d3-498d-4813-a5f7-5c9b6a2f549a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:29.432600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844fc35-0e4e-439e-a43d-364941b03914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:29.433262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844fc35-0e4e-439e-a43d-364941b03914 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:29.433547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844fc35-0e4e-439e-a43d-364941b03914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:29.433826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844fc35-0e4e-439e-a43d-364941b03914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:29.443174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844fc35-0e4e-439e-a43d-364941b03914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:29.444635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844fc35-0e4e-439e-a43d-364941b03914 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:29.454157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 719/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:31.605861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65fb9-0738-49d4-949d-d0671e6c7040 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:31.606464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65fb9-0738-49d4-949d-d0671e6c7040 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:31.606464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65fb9-0738-49d4-949d-d0671e6c7040 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:31.607834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:31.613521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858a4b7-9d89-4cde-9f23-b42e60510880 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:31.613950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858a4b7-9d89-4cde-9f23-b42e60510880 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:31.614083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858a4b7-9d89-4cde-9f23-b42e60510880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:31.634115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-4858a4b7-9d89-4cde-9f23-b42e60510880 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:31.635308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4858a4b7-9d89-4cde-9f23-b42e60510880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:31.644016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:31.686127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae65fb9-0738-49d4-949d-d0671e6c7040 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:31.701015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae65fb9-0738-49d4-949d-d0671e6c7040 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:31.705526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0165942-d06f-43ba-abe4-cc7d2c2f0065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:31.706191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165942-d06f-43ba-abe4-cc7d2c2f0065 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:31.706473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165942-d06f-43ba-abe4-cc7d2c2f0065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:31.706745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165942-d06f-43ba-abe4-cc7d2c2f0065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:31.715778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165942-d06f-43ba-abe4-cc7d2c2f0065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:31.717242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165942-d06f-43ba-abe4-cc7d2c2f0065 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:31.726725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 741/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:33.800699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c2e0-324b-41fe-a5d0-a679296f5700 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.801256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c2e0-324b-41fe-a5d0-a679296f5700 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.801256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c2e0-324b-41fe-a5d0-a679296f5700 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.802649 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:33.807842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48e0c-fae5-49e6-8881-fbac4f51ed36 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.808257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48e0c-fae5-49e6-8881-fbac4f51ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.808402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48e0c-fae5-49e6-8881-fbac4f51ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.814442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=79 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:33.828300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ccc48e0c-fae5-49e6-8881-fbac4f51ed36 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.829551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ccc48e0c-fae5-49e6-8881-fbac4f51ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.838508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:33.875842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c2e0-324b-41fe-a5d0-a679296f5700 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:33.882091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=73 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:33.888337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c2e0-324b-41fe-a5d0-a679296f5700 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:33.892072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7fa7c-a898-4654-9073-25ee95d4a7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:33.892699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7fa7c-a898-4654-9073-25ee95d4a7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.893564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7fa7c-a898-4654-9073-25ee95d4a7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.894067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7fa7c-a898-4654-9073-25ee95d4a7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.904052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7fa7c-a898-4654-9073-25ee95d4a7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:33.905535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7fa7c-a898-4654-9073-25ee95d4a7cd service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:33.915592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 722/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:35.969994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb2b4e-27ba-485a-883b-977fd417d145 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.970555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb2b4e-27ba-485a-883b-977fd417d145 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.970555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb2b4e-27ba-485a-883b-977fd417d145 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.972475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:48:35.978163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f3a46-afc7-4829-bc39-38eee205b75f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.978597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f3a46-afc7-4829-bc39-38eee205b75f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.978752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f3a46-afc7-4829-bc39-38eee205b75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.996899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b49f3a46-afc7-4829-bc39-38eee205b75f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:35.998119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b49f3a46-afc7-4829-bc39-38eee205b75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.007762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:36.047876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb2b4e-27ba-485a-883b-977fd417d145 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.059074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb2b4e-27ba-485a-883b-977fd417d145 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.062560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3815a-cda7-4841-8f06-b30e443e5a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.063187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3815a-cda7-4841-8f06-b30e443e5a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.063465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3815a-cda7-4841-8f06-b30e443e5a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.063738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3815a-cda7-4841-8f06-b30e443e5a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.072589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3815a-cda7-4841-8f06-b30e443e5a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.074040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3815a-cda7-4841-8f06-b30e443e5a65 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.083272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 744/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:38.128628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cd89-f2de-40f2-8eb2-214df143ff16 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.129200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cd89-f2de-40f2-8eb2-214df143ff16 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.129200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70cd89-f2de-40f2-8eb2-214df143ff16 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.130593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:38.135833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876847-9f65-4782-a69b-2313834505da None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.136258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876847-9f65-4782-a69b-2313834505da None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.136386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876847-9f65-4782-a69b-2313834505da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.153811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-70876847-9f65-4782-a69b-2313834505da None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:38.155022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-70876847-9f65-4782-a69b-2313834505da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:38.163722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:38.199278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70cd89-f2de-40f2-8eb2-214df143ff16 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:38.209931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70cd89-f2de-40f2-8eb2-214df143ff16 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:38.213376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c5738-b867-42bc-9ed7-104c0d4daeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:38.214001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5738-b867-42bc-9ed7-104c0d4daeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.214280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5738-b867-42bc-9ed7-104c0d4daeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.214553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c5738-b867-42bc-9ed7-104c0d4daeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.223947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5738-b867-42bc-9ed7-104c0d4daeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:38.225418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c5738-b867-42bc-9ed7-104c0d4daeb8 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:38.234543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 725/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:48.148846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=11 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:48.230512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=14 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:58.153464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75db92-2f9b-40b1-ad91-e86f86568133 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.154051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75db92-2f9b-40b1-ad91-e86f86568133 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.154153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75db92-2f9b-40b1-ad91-e86f86568133 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.155509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 746/1471] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:58.161744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1320b6-adee-45a8-8c7d-cf3f6e4e21ff None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.162146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1320b6-adee-45a8-8c7d-cf3f6e4e21ff None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.162296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1320b6-adee-45a8-8c7d-cf3f6e4e21ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.179956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0f1320b6-adee-45a8-8c7d-cf3f6e4e21ff None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:58.181180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0f1320b6-adee-45a8-8c7d-cf3f6e4e21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:58.188798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 726/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:58.271881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8237b-c0a8-44f8-a164-40b0952f32c2 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.272171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8237b-c0a8-44f8-a164-40b0952f32c2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.272448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8237b-c0a8-44f8-a164-40b0952f32c2 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.273844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 747/1473] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 5 20:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:58.278461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce659-15c4-4702-b49f-5ef6adb62fa8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.278751 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce659-15c4-4702-b49f-5ef6adb62fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.279029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ce659-15c4-4702-b49f-5ef6adb62fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.297169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-110ce659-15c4-4702-b49f-5ef6adb62fa8 None None] MFA Rules not processed for user `dbd8ecdcc21f4d22b969036c1d7a3672`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:58.298347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-110ce659-15c4-4702-b49f-5ef6adb62fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:58.305371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 727/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 5 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:48:58.312288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8237b-c0a8-44f8-a164-40b0952f32c2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.323566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8237b-c0a8-44f8-a164-40b0952f32c2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.327116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946e43e-3e85-4ffb-87b5-f40ed4062915 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.327745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e43e-3e85-4ffb-87b5-f40ed4062915 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.328032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e43e-3e85-4ffb-87b5-f40ed4062915 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.328313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946e43e-3e85-4ffb-87b5-f40ed4062915 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.337298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e43e-3e85-4ffb-87b5-f40ed4062915 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.338730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946e43e-3e85-4ffb-87b5-f40ed4062915 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.349566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 748/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:00.501037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17134-7be7-4f2d-8453-1acbe455f414 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.501482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17134-7be7-4f2d-8453-1acbe455f414 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.501586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a17134-7be7-4f2d-8453-1acbe455f414 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:00.503714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 728/1476] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:00.508899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aaff5-b9fa-4546-93b6-ec6288467f2f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.509365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aaff5-b9fa-4546-93b6-ec6288467f2f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.509478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aaff5-b9fa-4546-93b6-ec6288467f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:00.526943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ae6aaff5-b9fa-4546-93b6-ec6288467f2f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:00.528124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ae6aaff5-b9fa-4546-93b6-ec6288467f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:00.536330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 749/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:00.560012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17134-7be7-4f2d-8453-1acbe455f414 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:00.572895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a17134-7be7-4f2d-8453-1acbe455f414 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:00.577424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:00.578071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.578353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.578627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:00.579344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:00.581181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:49:00.581181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:49:00.581181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:49:00.582316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc247b-57e5-4992-93fa-f79b1c1f7c74 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:00.601680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 729/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 5 20:49:00 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:02.644736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7023a-ecea-460f-9674-b9f0c0456480 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.645329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7023a-ecea-460f-9674-b9f0c0456480 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.645450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7023a-ecea-460f-9674-b9f0c0456480 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.646722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 750/1479] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:02.652047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e48dd3-067b-4a48-a479-bdc2bab3fe9e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.652492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e48dd3-067b-4a48-a479-bdc2bab3fe9e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.652593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e48dd3-067b-4a48-a479-bdc2bab3fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.671031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d3e48dd3-067b-4a48-a479-bdc2bab3fe9e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:02.672211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d3e48dd3-067b-4a48-a479-bdc2bab3fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:02.680671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 730/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:02.726306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7023a-ecea-460f-9674-b9f0c0456480 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:02.741813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7023a-ecea-460f-9674-b9f0c0456480 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:02.748456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9949f-2c69-4c0f-918b-ecc266985ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:02.749076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9949f-2c69-4c0f-918b-ecc266985ae4 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.749367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9949f-2c69-4c0f-918b-ecc266985ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.749646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9949f-2c69-4c0f-918b-ecc266985ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.758673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9949f-2c69-4c0f-918b-ecc266985ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:02.760281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9949f-2c69-4c0f-918b-ecc266985ae4 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:02.770688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 751/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:04.973185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad478-d716-45f0-b7e7-b1ba55870c53 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:04.973756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad478-d716-45f0-b7e7-b1ba55870c53 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:04.973756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad478-d716-45f0-b7e7-b1ba55870c53 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:04.975101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 731/1482] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:04.980472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccbe64-42d7-4f4e-a8c6-b1708996cbfb None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:04.980898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccbe64-42d7-4f4e-a8c6-b1708996cbfb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:04.981080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccbe64-42d7-4f4e-a8c6-b1708996cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:04.999045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2fccbe64-42d7-4f4e-a8c6-b1708996cbfb None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:05.000229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2fccbe64-42d7-4f4e-a8c6-b1708996cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:05.008719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 752/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:05.044106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad478-d716-45f0-b7e7-b1ba55870c53 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:05.055152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad478-d716-45f0-b7e7-b1ba55870c53 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:05.058672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec763148-442f-494c-8431-882a9cab6e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:05.059295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763148-442f-494c-8431-882a9cab6e82 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:05.059564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763148-442f-494c-8431-882a9cab6e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:05.059840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec763148-442f-494c-8431-882a9cab6e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:05.069124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763148-442f-494c-8431-882a9cab6e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:05.070551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec763148-442f-494c-8431-882a9cab6e82 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:05.079744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 732/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:07.170555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b2a5-ec2e-444c-b307-465580ed4f51 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:07.171112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b2a5-ec2e-444c-b307-465580ed4f51 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:07.171112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b2a5-ec2e-444c-b307-465580ed4f51 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:07.172479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 753/1485] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:07.178275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f3012-9499-4243-9a75-cdda528f1786 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:07.178703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f3012-9499-4243-9a75-cdda528f1786 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:07.178817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f3012-9499-4243-9a75-cdda528f1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:07.196917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6d5f3012-9499-4243-9a75-cdda528f1786 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:07.198138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6d5f3012-9499-4243-9a75-cdda528f1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:07.205993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 733/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:07.243718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b2a5-ec2e-444c-b307-465580ed4f51 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:07.254924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637b2a5-ec2e-444c-b307-465580ed4f51 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:07.258498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00881432-2619-48be-8def-2071580e7d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:07.259127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881432-2619-48be-8def-2071580e7d78 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:07.259405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881432-2619-48be-8def-2071580e7d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:07.259679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881432-2619-48be-8def-2071580e7d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:07.268519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881432-2619-48be-8def-2071580e7d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:07.269978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881432-2619-48be-8def-2071580e7d78 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:07.279194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 754/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:09.457407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5783b-549a-42ba-8490-bd8de078c415 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:09.457974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5783b-549a-42ba-8490-bd8de078c415 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:09.457974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5783b-549a-42ba-8490-bd8de078c415 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:09.459351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 734/1488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:09.464395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e950-f0ba-44a3-b4e6-729596f78353 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:09.464853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e950-f0ba-44a3-b4e6-729596f78353 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:09.464984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5e950-f0ba-44a3-b4e6-729596f78353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:09.483021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3cc5e950-f0ba-44a3-b4e6-729596f78353 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:09.484221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3cc5e950-f0ba-44a3-b4e6-729596f78353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:09.492038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 755/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:09.531824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5783b-549a-42ba-8490-bd8de078c415 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:09.543725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5783b-549a-42ba-8490-bd8de078c415 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:09.547285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da9c95-8166-49d0-b519-84c997261d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:09.547919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da9c95-8166-49d0-b519-84c997261d0f service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:09.548204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da9c95-8166-49d0-b519-84c997261d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:09.548478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da9c95-8166-49d0-b519-84c997261d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:09.557353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da9c95-8166-49d0-b519-84c997261d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:09.558790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da9c95-8166-49d0-b519-84c997261d0f service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:09.568633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 735/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:11.768007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d93e2-f464-4d28-aba7-05bcd4093ff1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:11.768457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d93e2-f464-4d28-aba7-05bcd4093ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:11.768566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d93e2-f464-4d28-aba7-05bcd4093ff1 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:11.770028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 756/1491] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 5 20:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:11.776144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be664f-826f-4d3b-b7dd-41ba345c6ecc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:11.776604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be664f-826f-4d3b-b7dd-41ba345c6ecc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:11.776697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be664f-826f-4d3b-b7dd-41ba345c6ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:11.795540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-19be664f-826f-4d3b-b7dd-41ba345c6ecc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:11.796756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-19be664f-826f-4d3b-b7dd-41ba345c6ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:11.805271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 736/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 5 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:11.844316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d93e2-f464-4d28-aba7-05bcd4093ff1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:11.855325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d93e2-f464-4d28-aba7-05bcd4093ff1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:11.859511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e357082-0fdb-405a-a465-95117695bfdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:11.860180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357082-0fdb-405a-a465-95117695bfdc service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:11.860460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357082-0fdb-405a-a465-95117695bfdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:11.860733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e357082-0fdb-405a-a465-95117695bfdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:11.870294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e357082-0fdb-405a-a465-95117695bfdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:11.871728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e357082-0fdb-405a-a465-95117695bfdc service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:11.881717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 757/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:21.790646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=33 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:21.877467 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=33 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:38.370445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.371035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.371035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.391692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:38.392905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:38.400810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 737/1494] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:38.409782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.410307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.410436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.428118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:38.429339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:38.437218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 758/1495] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:38.441552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.450948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf6401-0ba7-44e6-bc83-cd6c1a80279d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.456022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.456664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.456963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.457241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.457957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:38.458276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.459279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:38.459279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:50:38.459279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:50:38.460158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.472268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 738/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:38.480169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.489713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b0cd-0f54-46d2-931f-ccf6b6e82c70 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.494318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.494972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.495254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.495530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.496210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.498028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:38.498028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:50:38.498028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:50:38.499947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.537152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 759/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:38 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:38.541346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.551236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ef4e-39f3-46ae-ae39-cc1cba77ca59 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.609197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.609880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.610163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.610436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.611128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.612147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:38.612147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:50:38.612147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:50:38.613387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.633001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 739/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:38 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:38.637137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.647691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2132c-df66-4fec-82d5-0a30fa4d2d4d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.652363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.653055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.653340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.653617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.654339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.656172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:38.656172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:50:38.656172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:50:38.657418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.669912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 760/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:38.674475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.684066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55796a-c457-44e2-9ea5-7bbc089dfe55 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.688769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.689458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.689742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.690017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.690727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.691735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:38.691735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:50:38.691735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:50:38.692604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c29a74-f372-431d-8850-1d86af7c1bc6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.707720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 740/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:38.712286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.723087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01f4f-72f1-4bbf-8000-a3ad53ba8760 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.727619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.728482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.728769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.729085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] PATH_INFO: `/v3/projects/ffc4af9a47974102a566368ad2e343b0/users/fc8d1b0a2b2a46cdafcbf94e0e10a42c/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.743950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc4af9a47974102a566368ad2e343b0, user_id=fc8d1b0a2b2a46cdafcbf94e0e10a42c, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.745013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:38.745013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:50:38.745013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:50:38.746957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272a16-291d-47f8-a6ff-a9fd4a37ff52 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.759475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 761/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:38 2022] PUT /identity/v3/projects/ffc4af9a47974102a566368ad2e343b0/users/fc8d1b0a2b2a46cdafcbf94e0e10a42c/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:38.772057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b30c-bc94-43e5-8504-ceb209b93b55 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.772346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b30c-bc94-43e5-8504-ceb209b93b55 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.772623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15b30c-bc94-43e5-8504-ceb209b93b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.799764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3c15b30c-bc94-43e5-8504-ceb209b93b55 None None] MFA Rules not processed for user `fc8d1b0a2b2a46cdafcbf94e0e10a42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:38.800991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3c15b30c-bc94-43e5-8504-ceb209b93b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:38.865111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 741/1502] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:38.878082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e523-9ba4-4c68-aaa7-ab9ac204a4b1 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.878374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e523-9ba4-4c68-aaa7-ab9ac204a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.878654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e523-9ba4-4c68-aaa7-ab9ac204a4b1 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.880325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 762/1503] 10.222.0.20 () {54 vars in 963 bytes} [Tue Jul 5 20:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:50:38.885255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfb14f-dd4d-4e1b-b1a5-8ab5685bbff0 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.885488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfb14f-dd4d-4e1b-b1a5-8ab5685bbff0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.885768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfb14f-dd4d-4e1b-b1a5-8ab5685bbff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.903479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a5cfb14f-dd4d-4e1b-b1a5-8ab5685bbff0 None None] MFA Rules not processed for user `04a4d556adeb43139a65f61af0076091`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:38.904650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a5cfb14f-dd4d-4e1b-b1a5-8ab5685bbff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:38.947954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:38.956288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 742/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Tue Jul 5 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:38.963966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e523-9ba4-4c68-aaa7-ab9ac204a4b1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:38.975057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e523-9ba4-4c68-aaa7-ab9ac204a4b1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:38.978514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:38.979141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:38.979422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:38.979696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:38.988478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:38.989934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:38.998510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 763/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:39.041191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2275-2939-423e-bc93-60029ce7b064 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:39.041479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2275-2939-423e-bc93-60029ce7b064 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:39.041754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2275-2939-423e-bc93-60029ce7b064 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:39.043037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 743/1506] 10.222.0.20 () {52 vars in 829 bytes} [Tue Jul 5 20:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:50:39.047619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:39.117427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df29d0-4b45-43fc-99b2-b10d4414bf20 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:39.122128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:39.123110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:39.123469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:39.123927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] PATH_INFO: `/v3/users/fc8d1b0a2b2a46cdafcbf94e0e10a42c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:39.125643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8d1b0a2b2a46cdafcbf94e0e10a42c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:39.126675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:39.126675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:50:39.126675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:50:39.127910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:39.196910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8d1b0a2b2a46cdafcbf94e0e10a42c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.215232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8d1b0a2b2a46cdafcbf94e0e10a42c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.229665 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8d1b0a2b2a46cdafcbf94e0e10a42c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.230495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8d1b0a2b2a46cdafcbf94e0e10a42c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.235171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:39.242922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8d1b0a2b2a46cdafcbf94e0e10a42c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.252573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 764/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:39 2022] DELETE /identity/v3/users/fc8d1b0a2b2a46cdafcbf94e0e10a42c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:39.256897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:39.257215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:39.257490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:39.275466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:39.276651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:39.335738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 744/1508] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:39.347917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:39.349401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:39.407003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e916-4c3e-4050-8717-6d4b7b0d9ec6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:39.410767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f456e-a7eb-40a2-bb3c-4ab509ef114e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:39.411414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f456e-a7eb-40a2-bb3c-4ab509ef114e service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:39.411700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f456e-a7eb-40a2-bb3c-4ab509ef114e service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:39.411976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f456e-a7eb-40a2-bb3c-4ab509ef114e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:39.420862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f456e-a7eb-40a2-bb3c-4ab509ef114e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:39.422423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f456e-a7eb-40a2-bb3c-4ab509ef114e service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:39.431774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 765/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:39.783170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:39.784623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:39.796262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2da9-6cf4-4432-970a-21d131d18fc8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:39.801527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:39.802408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:39.802688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:39.802969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] PATH_INFO: `/v3/projects/ffc4af9a47974102a566368ad2e343b0` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:39.804178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc4af9a47974102a566368ad2e343b0)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:39.805243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:50:39.805243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:50:39.805243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:50:39.806466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:39.866479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc4af9a47974102a566368ad2e343b0', 'request_id': 'req-0f824518-a32a-4903-8115-2611f28342c5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.872350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc4af9a47974102a566368ad2e343b0', 'request_id': 'req-0f824518-a32a-4903-8115-2611f28342c5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.881636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc4af9a47974102a566368ad2e343b0', 'request_id': 'req-0f824518-a32a-4903-8115-2611f28342c5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.901140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] The token cache is being invalidate because project ffc4af9a47974102a566368ad2e343b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:39.901438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.902190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0f824518-a32a-4903-8115-2611f28342c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:39.903725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 745/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:39 2022] DELETE /identity/v3/projects/ffc4af9a47974102a566368ad2e343b0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:49.427630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:49.898111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:17.266087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d61d1a-80ba-4da4-8798-64aeab9edf51 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:17.266698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d61d1a-80ba-4da4-8798-64aeab9edf51 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:17.266698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d61d1a-80ba-4da4-8798-64aeab9edf51 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:17.268058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:17.272914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbdd0e-acc9-47b8-a591-5643eb4f724a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:17.273376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbdd0e-acc9-47b8-a591-5643eb4f724a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:17.273485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbdd0e-acc9-47b8-a591-5643eb4f724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:17.294143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-57dbdd0e-acc9-47b8-a591-5643eb4f724a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:17.295325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-57dbdd0e-acc9-47b8-a591-5643eb4f724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:17.470938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:17.626205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d61d1a-80ba-4da4-8798-64aeab9edf51 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:17.627920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d2d61d1a-80ba-4da4-8798-64aeab9edf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:17.701656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d61d1a-80ba-4da4-8798-64aeab9edf51 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:17.707003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad398a25-4d6f-4a77-b46b-7597a90fc443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:17.707643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398a25-4d6f-4a77-b46b-7597a90fc443 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:17.707925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398a25-4d6f-4a77-b46b-7597a90fc443 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:17.708203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad398a25-4d6f-4a77-b46b-7597a90fc443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:17.716763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad398a25-4d6f-4a77-b46b-7597a90fc443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:17.718369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad398a25-4d6f-4a77-b46b-7597a90fc443 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:17.727532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 767/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:18.254968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557c555-afa7-42d7-8937-003b0e1387d0 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:18.255182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557c555-afa7-42d7-8937-003b0e1387d0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:18.255457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557c555-afa7-42d7-8937-003b0e1387d0 None None] PATH_INFO: `/v3` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:18.256800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 747/1514] 10.222.0.15 () {54 vars in 925 bytes} [Tue Jul 5 20:52:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:52:18.263725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3e0f-8141-414f-8d72-2e233d65ab63 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:18.264014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3e0f-8141-414f-8d72-2e233d65ab63 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:18.264293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea3e0f-8141-414f-8d72-2e233d65ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:18.283032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fcea3e0f-8141-414f-8d72-2e233d65ab63 None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:18.284224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fcea3e0f-8141-414f-8d72-2e233d65ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:18.347461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 768/1515] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jul 5 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:18.561686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a01883-c893-4b5a-8f4d-1fe75e18cd0e None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:18.562232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a01883-c893-4b5a-8f4d-1fe75e18cd0e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:18.562232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a01883-c893-4b5a-8f4d-1fe75e18cd0e None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:18.563639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:18.568634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c05ec-8917-441b-a31e-48f0576ef665 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:18.568945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c05ec-8917-441b-a31e-48f0576ef665 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:18.569218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c05ec-8917-441b-a31e-48f0576ef665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:18.587310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fc1c05ec-8917-441b-a31e-48f0576ef665 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:18.588497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fc1c05ec-8917-441b-a31e-48f0576ef665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:18.596855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:18.748725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a01883-c893-4b5a-8f4d-1fe75e18cd0e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:18.763718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a01883-c893-4b5a-8f4d-1fe75e18cd0e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:18.769106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13481b7f-47ee-4b07-951c-474d54b312ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:18.769748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481b7f-47ee-4b07-951c-474d54b312ae service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:18.770031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481b7f-47ee-4b07-951c-474d54b312ae service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:18.770307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13481b7f-47ee-4b07-951c-474d54b312ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:18.778974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13481b7f-47ee-4b07-951c-474d54b312ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:18.780842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13481b7f-47ee-4b07-951c-474d54b312ae service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:18.790302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 749/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:27.757263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef410-4961-4354-89ad-ab17da990570 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:27.757908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef410-4961-4354-89ad-ab17da990570 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:27.757908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef410-4961-4354-89ad-ab17da990570 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:27.759188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 770/1519] 10.222.0.20 () {54 vars in 960 bytes} [Tue Jul 5 20:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:27.765699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d84f57-c037-4816-8ece-7b4680d6eaf6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:27.765699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d84f57-c037-4816-8ece-7b4680d6eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:27.766188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d84f57-c037-4816-8ece-7b4680d6eaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:27.783661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c2d84f57-c037-4816-8ece-7b4680d6eaf6 None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:27.784840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c2d84f57-c037-4816-8ece-7b4680d6eaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:27.793285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 750/1520] 10.222.0.20 () {58 vars in 1057 bytes} [Tue Jul 5 20:52:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:27.800902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef410-4961-4354-89ad-ab17da990570 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:27.814488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef410-4961-4354-89ad-ab17da990570 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:27.819356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825876a-68cf-4f68-be16-50e64eef4c21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:27.819988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825876a-68cf-4f68-be16-50e64eef4c21 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:27.820267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825876a-68cf-4f68-be16-50e64eef4c21 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:27.820541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825876a-68cf-4f68-be16-50e64eef4c21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:27.829328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825876a-68cf-4f68-be16-50e64eef4c21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:27.830925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825876a-68cf-4f68-be16-50e64eef4c21 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:27.840633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 771/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:30.034726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bc062-fe6b-4e60-9d25-3787db49a455 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:30.035264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bc062-fe6b-4e60-9d25-3787db49a455 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:30.035264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bc062-fe6b-4e60-9d25-3787db49a455 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:30.036580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:52:30.041385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc707-8fc1-4efc-aa0a-9e06e5782727 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:30.042423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc707-8fc1-4efc-aa0a-9e06e5782727 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:30.042541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc707-8fc1-4efc-aa0a-9e06e5782727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:30.060024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f2bbc707-8fc1-4efc-aa0a-9e06e5782727 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:30.061237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f2bbc707-8fc1-4efc-aa0a-9e06e5782727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:30.068957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:30.221155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bc062-fe6b-4e60-9d25-3787db49a455 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:30.235456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bc062-fe6b-4e60-9d25-3787db49a455 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:30.240579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13558c7-7014-4bd0-bd7c-fe8808d92df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:30.241243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13558c7-7014-4bd0-bd7c-fe8808d92df9 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:30.241522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13558c7-7014-4bd0-bd7c-fe8808d92df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:30.241785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13558c7-7014-4bd0-bd7c-fe8808d92df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:30.250318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13558c7-7014-4bd0-bd7c-fe8808d92df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:30.251937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13558c7-7014-4bd0-bd7c-fe8808d92df9 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:30.261703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 752/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:31.082798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9fadc-979b-4387-8d0f-2fa6b7b7d1a7 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:31.083362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9fadc-979b-4387-8d0f-2fa6b7b7d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:31.083362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9fadc-979b-4387-8d0f-2fa6b7b7d1a7 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:31.084729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:31.089765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecf77-7223-4f22-82f2-c35c2cad9b1f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:31.090217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecf77-7223-4f22-82f2-c35c2cad9b1f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:31.090330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ecf77-7223-4f22-82f2-c35c2cad9b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:31.108628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8c8ecf77-7223-4f22-82f2-c35c2cad9b1f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:31.109876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8c8ecf77-7223-4f22-82f2-c35c2cad9b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:31.117772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:31.268208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9fadc-979b-4387-8d0f-2fa6b7b7d1a7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:31.283408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9fadc-979b-4387-8d0f-2fa6b7b7d1a7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:31.288712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e77ec-b3f7-4a4b-8a74-5d47315ab6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:31.289377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e77ec-b3f7-4a4b-8a74-5d47315ab6f2 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:31.289658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e77ec-b3f7-4a4b-8a74-5d47315ab6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:31.289938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e77ec-b3f7-4a4b-8a74-5d47315ab6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:31.298248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e77ec-b3f7-4a4b-8a74-5d47315ab6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:31.299827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e77ec-b3f7-4a4b-8a74-5d47315ab6f2 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:31.309219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 774/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:35.211656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51359b-a7ea-4a6f-9f14-fd5f4ad30e8f None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:35.212226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51359b-a7ea-4a6f-9f14-fd5f4ad30e8f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:35.212226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51359b-a7ea-4a6f-9f14-fd5f4ad30e8f None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:35.214024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:35.219111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241d46-317c-4685-95cd-a0139b2c4e2d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:35.219548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241d46-317c-4685-95cd-a0139b2c4e2d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:35.219671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241d46-317c-4685-95cd-a0139b2c4e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:35.237239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a2241d46-317c-4685-95cd-a0139b2c4e2d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:35.238443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a2241d46-317c-4685-95cd-a0139b2c4e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:35.246939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:35.321141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51359b-a7ea-4a6f-9f14-fd5f4ad30e8f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:35.323511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-bd51359b-a7ea-4a6f-9f14-fd5f4ad30e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:35.379900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51359b-a7ea-4a6f-9f14-fd5f4ad30e8f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:35.385938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dccd1a-af1f-490e-9f4b-587152335471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:35.386534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dccd1a-af1f-490e-9f4b-587152335471 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:35.386815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dccd1a-af1f-490e-9f4b-587152335471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:35.387091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dccd1a-af1f-490e-9f4b-587152335471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:35.396204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dccd1a-af1f-490e-9f4b-587152335471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:35.397672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dccd1a-af1f-490e-9f4b-587152335471 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:35.407440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 755/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:37.460989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe01e52-8253-44ff-ab89-115e3fcab520 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:37.461634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe01e52-8253-44ff-ab89-115e3fcab520 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:37.461634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe01e52-8253-44ff-ab89-115e3fcab520 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:37.463508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:52:37.469380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ffba9-b627-4b79-b08d-8df76810e25f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:37.469863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ffba9-b627-4b79-b08d-8df76810e25f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:37.469971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ffba9-b627-4b79-b08d-8df76810e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:37.488663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-544ffba9-b627-4b79-b08d-8df76810e25f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:37.490014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-544ffba9-b627-4b79-b08d-8df76810e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:37.498486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:37.537172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe01e52-8253-44ff-ab89-115e3fcab520 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:37.538864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-afe01e52-8253-44ff-ab89-115e3fcab520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:37.552632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe01e52-8253-44ff-ab89-115e3fcab520 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:37.556232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea86ee-dbb8-4e51-b219-bea0ef2d5c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:37.556954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea86ee-dbb8-4e51-b219-bea0ef2d5c75 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:37.557424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea86ee-dbb8-4e51-b219-bea0ef2d5c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:37.557704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea86ee-dbb8-4e51-b219-bea0ef2d5c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:37.566605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea86ee-dbb8-4e51-b219-bea0ef2d5c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:37.568028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea86ee-dbb8-4e51-b219-bea0ef2d5c75 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:37.577568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 777/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:41.271541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90e75-7a51-48c4-a4fb-ef987808194c None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:41.272127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90e75-7a51-48c4-a4fb-ef987808194c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:41.272127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90e75-7a51-48c4-a4fb-ef987808194c None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:41.273488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:41.278641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5acb-cdac-41f2-a2a2-1a572088067d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:41.279068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5acb-cdac-41f2-a2a2-1a572088067d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:41.279220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5acb-cdac-41f2-a2a2-1a572088067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:41.285766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:41.298296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-797e5acb-cdac-41f2-a2a2-1a572088067d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:41.299478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-797e5acb-cdac-41f2-a2a2-1a572088067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:41.307858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:41.612437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f90e75-7a51-48c4-a4fb-ef987808194c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:41.614118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-09f90e75-7a51-48c4-a4fb-ef987808194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:41.620124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=75 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:41.671501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f90e75-7a51-48c4-a4fb-ef987808194c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:41.674995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e791f1d-d1b8-4feb-8793-ec96c8205f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:41.675630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791f1d-d1b8-4feb-8793-ec96c8205f66 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:41.675909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791f1d-d1b8-4feb-8793-ec96c8205f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:41.676184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791f1d-d1b8-4feb-8793-ec96c8205f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:41.685193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e791f1d-d1b8-4feb-8793-ec96c8205f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:41.686615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e791f1d-d1b8-4feb-8793-ec96c8205f66 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:41.695836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 758/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:43.762730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc94e-4e46-4782-9fef-f35bfbc1dd07 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:43.763324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc94e-4e46-4782-9fef-f35bfbc1dd07 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:43.763324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fc94e-4e46-4782-9fef-f35bfbc1dd07 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:43.764657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:52:43.770012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dee30-8c29-440d-bda2-720c2484bdbf None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:43.770442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dee30-8c29-440d-bda2-720c2484bdbf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:43.770597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dee30-8c29-440d-bda2-720c2484bdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:43.788922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-893dee30-8c29-440d-bda2-720c2484bdbf None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:43.790144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-893dee30-8c29-440d-bda2-720c2484bdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:43.798859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:44.102506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc94e-4e46-4782-9fef-f35bfbc1dd07 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:44.104917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2e0fc94e-4e46-4782-9fef-f35bfbc1dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:44.118173 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fc94e-4e46-4782-9fef-f35bfbc1dd07 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:44.122463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c7f2-b6ed-4f7a-ada3-17d0822b7d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:44.123104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c7f2-b6ed-4f7a-ada3-17d0822b7d2e service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:44.123388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c7f2-b6ed-4f7a-ada3-17d0822b7d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:44.123667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c7f2-b6ed-4f7a-ada3-17d0822b7d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:44.136649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c7f2-b6ed-4f7a-ada3-17d0822b7d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:44.138223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c7f2-b6ed-4f7a-ada3-17d0822b7d2e service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:44.147973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 780/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:53.784240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=28 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:54.143598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=8 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:13.142058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.143266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.143803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.168990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.170809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.186462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 760/1540] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.196515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79d47-0d12-4607-8c62-8e14ade1d82b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.197654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79d47-0d12-4607-8c62-8e14ade1d82b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.202940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79d47-0d12-4607-8c62-8e14ade1d82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.225916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-86b79d47-0d12-4607-8c62-8e14ade1d82b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.227503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-86b79d47-0d12-4607-8c62-8e14ade1d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.239639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 781/1541] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.244506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.255965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c3fe3-f668-4dcf-a559-c1c07ed50d7d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.257796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f47e-1ff0-4bd7-8dc0-0736c185e386 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.259148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f47e-1ff0-4bd7-8dc0-0736c185e386 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.260023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932f47e-1ff0-4bd7-8dc0-0736c185e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.271981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.274448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.275994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.276520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.278299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:13.279769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.281683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.296022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1932f47e-1ff0-4bd7-8dc0-0736c185e386 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.298237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1932f47e-1ff0-4bd7-8dc0-0736c185e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.307859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 761/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:13.315327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.318788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 782/1543] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.328845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc35176-5b2a-4527-a49c-7ebc056e7db5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.329501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc35176-5b2a-4527-a49c-7ebc056e7db5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.330286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc35176-5b2a-4527-a49c-7ebc056e7db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.336570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad480a-9c10-464e-996d-fb907ce7f37b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.355261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.355948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.356232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.356506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.357225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.358264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:54:13.358264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:54:13.358264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:54:13.359462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29705b7-7876-4d7c-9888-b38e9953e9f2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.360581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bdc35176-5b2a-4527-a49c-7ebc056e7db5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.362072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bdc35176-5b2a-4527-a49c-7ebc056e7db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.376316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 783/1544] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:13.378447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e566b-3425-4736-8edf-bfced89e8e7e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.378980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e566b-3425-4736-8edf-bfced89e8e7e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.379941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e566b-3425-4736-8edf-bfced89e8e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.402413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-469e566b-3425-4736-8edf-bfced89e8e7e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.404805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-469e566b-3425-4736-8edf-bfced89e8e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.427063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 784/1545] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.430937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 762/1546] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:13.431578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16387-5873-4b31-a735-faf98c374c97 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.432139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16387-5873-4b31-a735-faf98c374c97 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.434031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a16387-5873-4b31-a735-faf98c374c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.436536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.437084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.437987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.476091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-33a16387-5873-4b31-a735-faf98c374c97 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.478183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.479691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.480039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-33a16387-5873-4b31-a735-faf98c374c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.554819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 763/1547] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.555664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.559691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 785/1548] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.560836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.561214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.561505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.572521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200e39f-cd2b-4893-8f6c-d4bcfaaafb6c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.577136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.577808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.578095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.578371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.579098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:13.579408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.581051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce52df9-b719-4774-861a-3007796a1fc6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.581442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.582632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.590662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 786/1549] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.591751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.596798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 764/1550] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:13.596798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96361f-1871-4582-9d8d-65e2371ab9cf None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.596798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96361f-1871-4582-9d8d-65e2371ab9cf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.596798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96361f-1871-4582-9d8d-65e2371ab9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.601848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166c65f-7604-4bce-9af4-acb1758d22e6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.606434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.607104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.607421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.607696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.608384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.609531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:54:13.609531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:54:13.609531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:54:13.610752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae30b5-4e7d-4d9b-857d-3800cb54a1c9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.618537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ea96361f-1871-4582-9d8d-65e2371ab9cf None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.620047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ea96361f-1871-4582-9d8d-65e2371ab9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.629435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 765/1551] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.631489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c93eb-677f-4975-a2ec-2e5820b9c36c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.631830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c93eb-677f-4975-a2ec-2e5820b9c36c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.632173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c93eb-677f-4975-a2ec-2e5820b9c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.634741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 787/1552] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:13.636193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11065af-d987-4ea5-af37-850ef0815715 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.636645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11065af-d987-4ea5-af37-850ef0815715 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.637104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11065af-d987-4ea5-af37-850ef0815715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.652257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-472c93eb-677f-4975-a2ec-2e5820b9c36c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.653823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-472c93eb-677f-4975-a2ec-2e5820b9c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.658178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d11065af-d987-4ea5-af37-850ef0815715 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.659410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d11065af-d987-4ea5-af37-850ef0815715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.661727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 766/1553] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.662966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.663245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.663505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.673265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 788/1554] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.674519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.674804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.675077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.682253 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.683450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.691420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 767/1555] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.692193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.694404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.695736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.702392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1dc13-d1ed-4887-967b-20036ebab76b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.704028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 789/1556] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.704907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.708012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.708716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.709031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.709306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.710018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:13.710321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.712109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.715620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7250b-4546-4608-aefa-dfc110d6fe4c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.720191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae7f4-3c61-44f8-9f06-93bcff2ee14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.720831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae7f4-3c61-44f8-9f06-93bcff2ee14e admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.721149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae7f4-3c61-44f8-9f06-93bcff2ee14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.721445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae7f4-3c61-44f8-9f06-93bcff2ee14e admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.722112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae7f4-3c61-44f8-9f06-93bcff2ee14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.724004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae7f4-3c61-44f8-9f06-93bcff2ee14e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.724333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 768/1557] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:13.731711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.734654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9955c8e-14bd-4a36-b2de-275b49f8ef02 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.739186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35a0fa-84a1-4ff6-b5bb-634d8e7505ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.740612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35a0fa-84a1-4ff6-b5bb-634d8e7505ea admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.740905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35a0fa-84a1-4ff6-b5bb-634d8e7505ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.741204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35a0fa-84a1-4ff6-b5bb-634d8e7505ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.741907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35a0fa-84a1-4ff6-b5bb-634d8e7505ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.743481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35a0fa-84a1-4ff6-b5bb-634d8e7505ea admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.756551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 769/1558] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:13.760437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 790/1559] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:13.760592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe186-9e4a-44dc-bd24-d1721c0db70f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.760592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe186-9e4a-44dc-bd24-d1721c0db70f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.760773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.760874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfe186-9e4a-44dc-bd24-d1721c0db70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.761021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.761021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.778711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.779110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-48cfe186-9e4a-44dc-bd24-d1721c0db70f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.779918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.780265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-48cfe186-9e4a-44dc-bd24-d1721c0db70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.839211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 770/1560] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.840515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.840797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.841104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.844379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 791/1561] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.845297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.847684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:13.855139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805540a-b23c-4b1a-b59e-8e0096ca9e6e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.859896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.860552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.860835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.861140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.861862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:13.861981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:13.862166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.863073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:13.863192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:54:13.863192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:54:13.863192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:54:13.864028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.872185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 771/1562] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:13.872974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.878452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 792/1563] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:13.885546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa234e1-6122-4b4c-9de9-92dd41cc3576 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.885646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.889705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.890376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.891802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.891802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.891802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:13.892078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.892168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:13.893712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.899158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2a80-30b3-40ba-b715-13b46fd7b02c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.905650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.906282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.906568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.906852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.907138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 772/1564] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:13.907613 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.908061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.909589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.919159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78b670-e4e1-4c6c-b262-b379cefa50f7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:13.924658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:13.925350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:13.925639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:13.925915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:13.926666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:13.929321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:13.938061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 793/1565] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:13.938750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.942903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 773/1566] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:13.942903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:13.952240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c140b9d-3e9c-4cda-945f-8a043ae8999d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.004496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e111-0588-4530-b88c-92a708fd5c28 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.007565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.008227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.008514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.008777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.009517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:14.009804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.009936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.010473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.010753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.011026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.011393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.011702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.013753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.023964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 774/1567] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:14.025166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.036262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999689d3-b814-43dc-9cc7-90b995368b4c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.038852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 794/1568] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:13 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.040133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.041062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.041709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.041988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.042258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.043016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:14.043340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.044908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.050242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd797-25dd-44cb-a0b0-048c0f948aca admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.054970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.055619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.055904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.056184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.056897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:14.057308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.057922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 775/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:14.058961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.059089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.072013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 795/1570] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:14.072955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.075978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb867f8-b5b3-4734-8085-a0f368471f3c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.080697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.081371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.081651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.081922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.082594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.082801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2724f-c423-48ac-9fb8-3bf360e77ef6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.085194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.088373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.089063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.089353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.089628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.090307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.092216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.111223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 776/1571] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.112137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.118915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 796/1572] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.119716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.175351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8d8c-982d-47ef-92b2-7577b62d8ea4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.180528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.181219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.181498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.181770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.182446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.184382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.184992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbc883-5e45-41f3-a3b2-411e53acd6fb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.190024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.190916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.191203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.191483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] PATH_INFO: `/v3/projects/73388b11deda4e90a6ed52e6a1ef3bd3/users/4fb09a01017a430fa2f8e7d1e420cc3d/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.204780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 777/1573] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.205605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.207832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73388b11deda4e90a6ed52e6a1ef3bd3, user_id=4fb09a01017a430fa2f8e7d1e420cc3d, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.211335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.215717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7dbe73-bdd1-4c08-8739-571dd365b124 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.220667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.221337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.221691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.221885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.222555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.225029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.225554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 797/1574] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:14 2022] PUT /identity/v3/projects/73388b11deda4e90a6ed52e6a1ef3bd3/users/4fb09a01017a430fa2f8e7d1e420cc3d/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:14.226409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.243700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.252249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 778/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.253203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.253792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.301246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e9e35-f6d5-479d-8fc9-0b10cc86dec5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.317445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98eb1-e07c-4569-88d6-a4faa0e622ba admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.322221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.322876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.323153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.323419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.324086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.326022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.353935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 779/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.355024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.363853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.364522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.364855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.365220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.365984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.367690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.377626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 798/1577] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.378480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.388606 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61f8b-0dc1-4f9c-83e0-d55f95ff9e41 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.417043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544f848-0ee3-4d7a-ada3-921dbcce42b1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.421776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.422441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.422723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.422999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.423687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.425732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.445465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.446137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.446420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.446701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.447558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.449586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.451840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 780/1578] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.452721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.470835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 799/1579] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.471677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.481867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd3936-9ee3-4d38-86bf-919d518df28d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.518812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef3af8-95ea-406f-912d-134881ecbc4b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.524078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bba68c-60d6-41d0-aa21-b376d95ff4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.524746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba68c-60d6-41d0-aa21-b376d95ff4af admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.525060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba68c-60d6-41d0-aa21-b376d95ff4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.525338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bba68c-60d6-41d0-aa21-b376d95ff4af admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.526024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba68c-60d6-41d0-aa21-b376d95ff4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.528571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bba68c-60d6-41d0-aa21-b376d95ff4af admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.531129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.542914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.543597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.543914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.544164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.544896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.545418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.546678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.551927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 781/1580] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.554211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.555001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.555361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.560360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 800/1581] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.560360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.570166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8a554-9942-435d-a003-0aee869b69a3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.576020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.576677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.576995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.577276 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.577957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.579866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.586235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] MFA Rules not processed for user `4fb09a01017a430fa2f8e7d1e420cc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:14.587447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:14.603904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 801/1582] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.603904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.613359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47f45-dc49-4232-bbd7-ef22495aecc0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.618214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.618854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.619138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.619410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.620080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.622023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.644220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 802/1583] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.645255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.655906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6d30-b768-4140-acfb-0ce8017e31cc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.659600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 782/1584] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:14.660408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.664701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.665463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.665815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.666160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.666951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.668542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.670945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e218b55-7eb1-4525-8d46-702a0b3855f0 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.675555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.676326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.676556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.676827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.677745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.680138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 803/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.680559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.683175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.690859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e459b-c8eb-4bd2-ac29-efe459738b93 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.697171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.698077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.698417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.698702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.699460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.701191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.707209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 783/1586] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:14.710344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.715504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 804/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.715504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.723337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a940-5146-4eb5-b55b-bea40cfb355e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.723580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ba5e9-53b9-4eb6-881f-4fe02c93217d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.728077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.728490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.728731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.729072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.729349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.729457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.729634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.729913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.730066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.730637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.731686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.732255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.742313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 784/1588] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.742917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.743367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 805/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.744265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.753982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca384bbb-8c74-45ca-bc60-337f78091fcd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.754574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d64e5-63f1-478e-b683-c7e64c587b99 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.759474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.759642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11152c34-cda7-492e-8265-36a87893058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.760126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.760416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.760606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152c34-cda7-492e-8265-36a87893058a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.760705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.760890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152c34-cda7-492e-8265-36a87893058a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.761227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152c34-cda7-492e-8265-36a87893058a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.761439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.761936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11152c34-cda7-492e-8265-36a87893058a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.763041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.763501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11152c34-cda7-492e-8265-36a87893058a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.778566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 806/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.778566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.778840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 785/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.778840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772f8e-910d-467d-bba8-7ef20842d861 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.778840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772f8e-910d-467d-bba8-7ef20842d861 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.778840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772f8e-910d-467d-bba8-7ef20842d861 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.781337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 786/1592] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 5 20:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:14.781337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772f8e-910d-467d-bba8-7ef20842d861 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.791836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa355-8be0-4809-a601-42f88aa9a5dc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.792533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772f8e-910d-467d-bba8-7ef20842d861 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.796370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.797022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.797373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.797653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.797769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.797925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] PATH_INFO: `/v3/projects/873a5ea6741e4762857e2bae05f5e06d/users/5063db22225a4d0b97ec5dcac8770045/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.798064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.798184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.798894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.800494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.813557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 787/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.813557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.813816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873a5ea6741e4762857e2bae05f5e06d, user_id=5063db22225a4d0b97ec5dcac8770045, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.815125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.821580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27aa05-3ba2-4a69-babb-0db0f8e11aef admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.826608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.827258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.827742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.828039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.828766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.828907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 807/1594] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:14 2022] PUT /identity/v3/projects/873a5ea6741e4762857e2bae05f5e06d/users/5063db22225a4d0b97ec5dcac8770045/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:14.829727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.830479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.842273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 788/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.843148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.854119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4865-623a-4ebb-8d3e-0f7d753e167f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.892892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92312d-631b-4785-885c-bc380620ddd9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.898532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.899204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.899489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.899769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.900504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.902241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.910857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.911972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.912254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.912477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 808/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.913453 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.915690 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] PATH_INFO: `/v3/projects/c47e1ad014d542f98f6b24c8a504d166/users/5eac41ce3f04450b840cff305ec1a5ac/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.923018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d414ae-624d-40b8-b16c-3f8b419b216d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.928485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:14.929443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.929746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.930006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.930720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.931702 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47e1ad014d542f98f6b24c8a504d166, user_id=5eac41ce3f04450b840cff305ec1a5ac, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:14.932325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.932742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:54:14.932742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:54:14.932742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:54:14.934755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42907608-1721-4229-bc71-c29f26b228bb admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:14.946223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 809/1597] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:14.946223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:14.951728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 789/1598] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:14 2022] PUT /identity/v3/projects/c47e1ad014d542f98f6b24c8a504d166/users/5eac41ce3f04450b840cff305ec1a5ac/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:14.953209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff687-1f5e-452d-96f5-d06cc64a6fc1 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:14.953565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff687-1f5e-452d-96f5-d06cc64a6fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:14.953907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff687-1f5e-452d-96f5-d06cc64a6fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:14.954566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14461c-f2a2-45e5-a445-91b6dd399230 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:14.971403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-85cff687-1f5e-452d-96f5-d06cc64a6fc1 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:14.972616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-85cff687-1f5e-452d-96f5-d06cc64a6fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:14.976990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:14.982257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.016328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.017042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.017326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.017603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.018351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.019960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.030655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 810/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:15.031466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.044803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b171-cf4d-4ef2-a181-7a8cb4f2afcb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.045221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 790/1600] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 5 20:54:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.046677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.047151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.047411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.049815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.050470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.050756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.051034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.051798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.053915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.063927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 811/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:15.064701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.066754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.068765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.074899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47356b-dd3b-4d8d-9777-37ec5cfa3e71 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.076945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 791/1602] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.077804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.079557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.081032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.081032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.081236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] PATH_INFO: `/v3/projects/2936af0b060a40f386b4112e4f9f3cbe/users/096bc057113f484c9e15ae58cd12cd4a/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.088191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a82dd-d26e-4f76-8509-c64544cc2f7c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.092870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a8cef-ab25-4934-8204-56f6a5560660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.093785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a8cef-ab25-4934-8204-56f6a5560660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.094072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a8cef-ab25-4934-8204-56f6a5560660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.094347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a8cef-ab25-4934-8204-56f6a5560660 admin admin] PATH_INFO: `/v3/projects/dd927c646e744d0085f21250438a5200/users/988c73656593483994c53b80cb5ddbb1/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.097832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2936af0b060a40f386b4112e4f9f3cbe, user_id=096bc057113f484c9e15ae58cd12cd4a, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.100850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.110080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a8cef-ab25-4934-8204-56f6a5560660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd927c646e744d0085f21250438a5200, user_id=988c73656593483994c53b80cb5ddbb1, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.112739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a8cef-ab25-4934-8204-56f6a5560660 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.126464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 812/1603] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:15 2022] PUT /identity/v3/projects/2936af0b060a40f386b4112e4f9f3cbe/users/096bc057113f484c9e15ae58cd12cd4a/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:15.126464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.133012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 792/1604] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:15 2022] PUT /identity/v3/projects/dd927c646e744d0085f21250438a5200/users/988c73656593483994c53b80cb5ddbb1/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:15.134757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.135115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.135501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.153338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.154536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.189600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1810d-78b0-47cd-9780-c19795e54fbb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.213307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 793/1605] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.214668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.224014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88d28d-20c4-4564-98f5-690fe08a6d04 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.228836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.229760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.230041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.230309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] PATH_INFO: `/v3/projects/9c5fb5bc86604f38b5f0f3a46525189a/users/a3792881ae73408db651dd6eb09b3d25/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.245689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5fb5bc86604f38b5f0f3a46525189a, user_id=a3792881ae73408db651dd6eb09b3d25, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.246662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.247552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.247836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.248115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] PATH_INFO: `/v3/projects/ce0fdcac2fc84876bb72a68abaa107ab/users/ac77bdee7e0c40e69f40b510aed8258b/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.248320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.263364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 794/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:15 2022] PUT /identity/v3/projects/9c5fb5bc86604f38b5f0f3a46525189a/users/a3792881ae73408db651dd6eb09b3d25/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:15.265277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.267984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0fdcac2fc84876bb72a68abaa107ab, user_id=ac77bdee7e0c40e69f40b510aed8258b, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.270906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.285409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 813/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:15 2022] PUT /identity/v3/projects/ce0fdcac2fc84876bb72a68abaa107ab/users/ac77bdee7e0c40e69f40b510aed8258b/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:15.286278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.314708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.318661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.338436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec68b2-d0a2-49cb-9e8c-0fe2799f66dd admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.361866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64be49-4f7d-44f9-a4ba-0e0b6c8d83a2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.367207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.368155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.368462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.369020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] PATH_INFO: `/v3/projects/fc6d47f96d17471d94367bc8f8a3e3f6/users/d152763a64794301b21587ab2b395bbf/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.383154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6d47f96d17471d94367bc8f8a3e3f6, user_id=d152763a64794301b21587ab2b395bbf, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.385853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.399071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 814/1608] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:15 2022] PUT /identity/v3/projects/fc6d47f96d17471d94367bc8f8a3e3f6/users/d152763a64794301b21587ab2b395bbf/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:15.399866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.403913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29660b0d-6909-4579-be58-4074ffc247d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.404777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29660b0d-6909-4579-be58-4074ffc247d7 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.405656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29660b0d-6909-4579-be58-4074ffc247d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.405941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29660b0d-6909-4579-be58-4074ffc247d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.454164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a8969-72fd-4f54-984d-aab4ccaa2b7c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.457795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1f2c6-dbd7-4302-bd8e-1062e0d9fe43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.458436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f2c6-dbd7-4302-bd8e-1062e0d9fe43 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.458750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f2c6-dbd7-4302-bd8e-1062e0d9fe43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.459025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1f2c6-dbd7-4302-bd8e-1062e0d9fe43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.462697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29660b0d-6909-4579-be58-4074ffc247d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.465159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29660b0d-6909-4579-be58-4074ffc247d7 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.474885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 795/1609] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:15.476136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.476423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.476697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.502036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] MFA Rules not processed for user `096bc057113f484c9e15ae58cd12cd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.503249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.524573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1f2c6-dbd7-4302-bd8e-1062e0d9fe43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.526197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1f2c6-dbd7-4302-bd8e-1062e0d9fe43 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.537645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 815/1610] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:15.538766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2dd8d-0e32-4cf9-a4d6-64c145f67a45 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.539057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2dd8d-0e32-4cf9-a4d6-64c145f67a45 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.539334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2dd8d-0e32-4cf9-a4d6-64c145f67a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.569472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 796/1611] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.570147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.578901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e8a2dd8d-0e32-4cf9-a4d6-64c145f67a45 None None] MFA Rules not processed for user `988c73656593483994c53b80cb5ddbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.579890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9087ff3-17c5-4681-8156-d29fceb28956 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.580188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e8a2dd8d-0e32-4cf9-a4d6-64c145f67a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.584538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a04e4a-2929-45ed-ac6b-c4c1a5adaf1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.585223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a04e4a-2929-45ed-ac6b-c4c1a5adaf1a service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.585502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a04e4a-2929-45ed-ac6b-c4c1a5adaf1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.585779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a04e4a-2929-45ed-ac6b-c4c1a5adaf1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.597734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a04e4a-2929-45ed-ac6b-c4c1a5adaf1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.600419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a04e4a-2929-45ed-ac6b-c4c1a5adaf1a service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.606455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.618388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 797/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:15.622769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210fd14-dbb0-4b4a-b62d-02ce7ef83f87 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.623633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210fd14-dbb0-4b4a-b62d-02ce7ef83f87 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.624079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210fd14-dbb0-4b4a-b62d-02ce7ef83f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.631798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:15.654681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-7210fd14-dbb0-4b4a-b62d-02ce7ef83f87 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.656364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7210fd14-dbb0-4b4a-b62d-02ce7ef83f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.669828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 798/1613] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.672224 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.672849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.673427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.679661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 816/1614] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.679661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.679661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.679661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.706371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.708985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.719835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 817/1615] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.724220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.726412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] MFA Rules not processed for user `ac77bdee7e0c40e69f40b510aed8258b`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:15.727742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:15.736034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec3dac-85ad-4dd8-9996-a706dbad28a5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.744362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.745381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.745882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.746893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.748270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.751182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.790620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 818/1616] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:15.791473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.811718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 799/1617] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:15.812537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.875036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc57e-4dc9-402c-a1bb-e058dbc66b32 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.879270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a46a-c9e7-4741-9fbb-811e8dc6c350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.880001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a46a-c9e7-4741-9fbb-811e8dc6c350 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.881174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a46a-c9e7-4741-9fbb-811e8dc6c350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.881174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a46a-c9e7-4741-9fbb-811e8dc6c350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.900092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf818d-e200-429d-bbbc-ea3c07c5ff6e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.956496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a46a-c9e7-4741-9fbb-811e8dc6c350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:15.958302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a46a-c9e7-4741-9fbb-811e8dc6c350 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:15.970907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 819/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:15.972289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e837691-271d-4b6f-a580-b2a7d8a2d52c None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.972575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e837691-271d-4b6f-a580-b2a7d8a2d52c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.972847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e837691-271d-4b6f-a580-b2a7d8a2d52c None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.974751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 820/1619] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 5 20:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:15.975487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e837691-271d-4b6f-a580-b2a7d8a2d52c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:15.988536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e837691-271d-4b6f-a580-b2a7d8a2d52c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:15.988763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d444d2-1c84-4de9-aad0-9e2f59bd481f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.989643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d444d2-1c84-4de9-aad0-9e2f59bd481f service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.990941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d444d2-1c84-4de9-aad0-9e2f59bd481f service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.991258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d444d2-1c84-4de9-aad0-9e2f59bd481f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:15.993914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:15.994893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:15.995239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:15.995758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.011698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.013312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.025475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 821/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:16.026482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.038906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e206b-67ed-46aa-b849-2a03fcc1a26b service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.046539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb71c45-f692-4236-97d4-418bd9fe3165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.047452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71c45-f692-4236-97d4-418bd9fe3165 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.047918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71c45-f692-4236-97d4-418bd9fe3165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.048198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb71c45-f692-4236-97d4-418bd9fe3165 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.049439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71c45-f692-4236-97d4-418bd9fe3165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.053452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb71c45-f692-4236-97d4-418bd9fe3165 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.054386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:16.065963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d444d2-1c84-4de9-aad0-9e2f59bd481f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.067891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d444d2-1c84-4de9-aad0-9e2f59bd481f service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.080429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 800/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:16.084722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 822/1622] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:16 2022] POST /identity/v3/users => generated 303 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:16.084904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad582b-a5c1-47ea-8430-e814e4135622 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.084904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad582b-a5c1-47ea-8430-e814e4135622 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.084904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad582b-a5c1-47ea-8430-e814e4135622 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.085185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653c45b-350b-4072-93ca-93afa599961d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.085185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653c45b-350b-4072-93ca-93afa599961d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.085185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653c45b-350b-4072-93ca-93afa599961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.085405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 801/1623] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 5 20:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:16.086029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad582b-a5c1-47ea-8430-e814e4135622 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.102382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad582b-a5c1-47ea-8430-e814e4135622 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.107150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1653c45b-350b-4072-93ca-93afa599961d None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:16.107339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92233d8-7cc1-4291-8ecb-10c35258e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.108205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92233d8-7cc1-4291-8ecb-10c35258e82c admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.108386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1653c45b-350b-4072-93ca-93afa599961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:16.108572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92233d8-7cc1-4291-8ecb-10c35258e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.109132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92233d8-7cc1-4291-8ecb-10c35258e82c admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.110089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92233d8-7cc1-4291-8ecb-10c35258e82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.112160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92233d8-7cc1-4291-8ecb-10c35258e82c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.125537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 802/1624] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:16.125537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.125537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.125537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.146845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:16.153740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:16.156548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:16.196419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 823/1625] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:16.197547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653c45b-350b-4072-93ca-93afa599961d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.211617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653c45b-350b-4072-93ca-93afa599961d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.216971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.217984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.218548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.218892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] PATH_INFO: `/v3/projects/321f64fa1cd44391b87eefcb677d1747/users/ffd9ba2bf974470ebdcad7277b3c3ebb/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.238257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321f64fa1cd44391b87eefcb677d1747, user_id=ffd9ba2bf974470ebdcad7277b3c3ebb, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.242098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.257573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 803/1626] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 5 20:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:16.258732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.264021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 824/1627] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:16 2022] PUT /identity/v3/projects/321f64fa1cd44391b87eefcb677d1747/users/ffd9ba2bf974470ebdcad7277b3c3ebb/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:16.265290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.270070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add30e15-a8e0-45d2-b1c0-fd90491da4c9 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.347773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.348704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.349058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.349305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.450393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.452172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.452479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb689a5-fb3f-40ea-9341-481f62eebb30 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.469110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 804/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:16.470356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.470479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.471199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.471485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.471836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.500780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:16.551342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.553730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.566708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 825/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:16.624034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e9d78-f3c2-4d19-afd0-07b9ca4aa483 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.647000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c199f-26c0-4be6-adce-c820f06368ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.647845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c199f-26c0-4be6-adce-c820f06368ea admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.648127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c199f-26c0-4be6-adce-c820f06368ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.648395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c199f-26c0-4be6-adce-c820f06368ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.650182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c199f-26c0-4be6-adce-c820f06368ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.654110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c199f-26c0-4be6-adce-c820f06368ea admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.679391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 805/1630] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:16.683825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:16.714413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434a75e-a102-4b2c-8420-b836a42fe11b service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:16.730782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75d517-01ce-4246-9006-3e0a93897129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:16.733759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d517-01ce-4246-9006-3e0a93897129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.734029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d517-01ce-4246-9006-3e0a93897129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.735330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75d517-01ce-4246-9006-3e0a93897129 admin admin] PATH_INFO: `/v3/projects/321f64fa1cd44391b87eefcb677d1747/users/ffd9ba2bf974470ebdcad7277b3c3ebb/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.743715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75d517-01ce-4246-9006-3e0a93897129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321f64fa1cd44391b87eefcb677d1747, user_id=ffd9ba2bf974470ebdcad7277b3c3ebb, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:16.752949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75d517-01ce-4246-9006-3e0a93897129 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:16.803880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 826/1631] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:16 2022] PUT /identity/v3/projects/321f64fa1cd44391b87eefcb677d1747/users/ffd9ba2bf974470ebdcad7277b3c3ebb/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:16.805381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.805682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.806483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.866493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] MFA Rules not processed for user `ffd9ba2bf974470ebdcad7277b3c3ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:16.868785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:16.913703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89135-0cfe-44e1-8a01-aef048c0d906 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.913993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89135-0cfe-44e1-8a01-aef048c0d906 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.914321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89135-0cfe-44e1-8a01-aef048c0d906 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.918054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 827/1632] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 5 20:54:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:54:16.926425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310312-6020-407d-a749-25d2c6724482 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:16.928126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310312-6020-407d-a749-25d2c6724482 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:16.928589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70310312-6020-407d-a749-25d2c6724482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:16.983944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-70310312-6020-407d-a749-25d2c6724482 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:16.986423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-70310312-6020-407d-a749-25d2c6724482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:17.038862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 806/1633] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:17.046163 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:17.232320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 828/1634] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:17.282681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:17.382734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70310312-6020-407d-a749-25d2c6724482 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:17.452911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60436af-526c-407c-b215-2e5afcb537d5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:17.464109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:17.465493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:17.465493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:17.465493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:17.501913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:17.503389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:17.539137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 807/1635] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:17.544281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70310312-6020-407d-a749-25d2c6724482 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:17.556625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:17.557464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:17.557754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:17.558029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:17.581654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:17.583130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:17.610247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 829/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:17.892054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:17.905652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3002fa-0c98-484e-abd4-2a641e4b1c4d service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:17.916575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e084a-89bc-4f0e-a24c-eecef7fb3149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:17.922324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e084a-89bc-4f0e-a24c-eecef7fb3149 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:17.922884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e084a-89bc-4f0e-a24c-eecef7fb3149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:17.926892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e084a-89bc-4f0e-a24c-eecef7fb3149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:17.997198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:18.042563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e084a-89bc-4f0e-a24c-eecef7fb3149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:18.044798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e084a-89bc-4f0e-a24c-eecef7fb3149 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:18.064628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 808/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:21.301811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:21.404971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff16510-30c3-4ac3-b9d2-cb6a02c0922e service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:21.430444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:21.431691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:21.432531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:21.433978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] PATH_INFO: `/v3/users/4fb09a01017a430fa2f8e7d1e420cc3d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:21.436529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb09a01017a430fa2f8e7d1e420cc3d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:21.443138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:21.593979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb09a01017a430fa2f8e7d1e420cc3d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:21.625434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:21.627856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb09a01017a430fa2f8e7d1e420cc3d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:21.647112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb09a01017a430fa2f8e7d1e420cc3d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:21.659914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb09a01017a430fa2f8e7d1e420cc3d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:21.684655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb09a01017a430fa2f8e7d1e420cc3d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:21.714527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 830/1638] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:21 2022] DELETE /identity/v3/users/4fb09a01017a430fa2f8e7d1e420cc3d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:21.719997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ccb50-37fa-43c5-adf8-a198b667cf92 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:21.720876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ccb50-37fa-43c5-adf8-a198b667cf92 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:21.721413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ccb50-37fa-43c5-adf8-a198b667cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:21.760312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0e7ccb50-37fa-43c5-adf8-a198b667cf92 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:21.762397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0e7ccb50-37fa-43c5-adf8-a198b667cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:21.918821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 809/1639] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:21.940035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:21.944294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:22.091648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad20f9-cbaf-4cd5-8400-706763a85bc7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:22.102696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97f8fc-c1cd-40d9-a78d-a1e5f032b852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:22.102696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f8fc-c1cd-40d9-a78d-a1e5f032b852 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:22.103042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f8fc-c1cd-40d9-a78d-a1e5f032b852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:22.103699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97f8fc-c1cd-40d9-a78d-a1e5f032b852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:22.122749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97f8fc-c1cd-40d9-a78d-a1e5f032b852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:22.124373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97f8fc-c1cd-40d9-a78d-a1e5f032b852 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:22.139120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 831/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:23.408243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:23.408727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:23.408809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:23.462850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] MFA Rules not processed for user `5063db22225a4d0b97ec5dcac8770045`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:23.464556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:23.627570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 810/1641] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:23.638960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586748b-9237-424b-8672-6a6465969bad None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:23.639448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586748b-9237-424b-8672-6a6465969bad None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:23.639707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586748b-9237-424b-8672-6a6465969bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:23.719982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1586748b-9237-424b-8672-6a6465969bad None None] MFA Rules not processed for user `5063db22225a4d0b97ec5dcac8770045`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:23.721660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1586748b-9237-424b-8672-6a6465969bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:23.739107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 832/1642] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:23.762202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:23.767507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:23.939568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:23.951037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a9315-b70f-42da-bf8a-f4a755e57e16 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:23.971492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e5cef-b9c1-4e3b-adfd-278d216c5273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:23.974732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e5cef-b9c1-4e3b-adfd-278d216c5273 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:23.975098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e5cef-b9c1-4e3b-adfd-278d216c5273 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:23.975375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e5cef-b9c1-4e3b-adfd-278d216c5273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:24.000785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e5cef-b9c1-4e3b-adfd-278d216c5273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:24.003519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e5cef-b9c1-4e3b-adfd-278d216c5273 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:24.026475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 811/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:24.711528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586748b-9237-424b-8672-6a6465969bad None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:24.712989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1586748b-9237-424b-8672-6a6465969bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:24.735432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586748b-9237-424b-8672-6a6465969bad None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:24.762808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:24.765103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:24.765615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:24.766048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] PATH_INFO: `/v3/projects/73388b11deda4e90a6ed52e6a1ef3bd3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:24.768197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73388b11deda4e90a6ed52e6a1ef3bd3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:24.770176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: WARNING py.warnings [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:54:24.770176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: warnings.warn(msg) Jul 05 20:54:24.770176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: Jul 05 20:54:24.773010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:24.917613 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73388b11deda4e90a6ed52e6a1ef3bd3', 'request_id': 'req-36533372-e17b-4624-aa84-4d94265e2664'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:24.927959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73388b11deda4e90a6ed52e6a1ef3bd3', 'request_id': 'req-36533372-e17b-4624-aa84-4d94265e2664'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:24.949111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73388b11deda4e90a6ed52e6a1ef3bd3', 'request_id': 'req-36533372-e17b-4624-aa84-4d94265e2664'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:24.979640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] The token cache is being invalidate because project 73388b11deda4e90a6ed52e6a1ef3bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:24.980605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:24.983161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-36533372-e17b-4624-aa84-4d94265e2664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:24.988812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 833/1644] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:24 2022] DELETE /identity/v3/projects/73388b11deda4e90a6ed52e6a1ef3bd3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:24.993887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d799d-63b8-4265-bb27-975459e691c9 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:24.998056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d799d-63b8-4265-bb27-975459e691c9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:24.998859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d799d-63b8-4265-bb27-975459e691c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.028080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac127a7-aaaf-4b19-b689-a908f702c451 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.028373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac127a7-aaaf-4b19-b689-a908f702c451 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.028840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac127a7-aaaf-4b19-b689-a908f702c451 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.031157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 834/1645] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 5 20:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:25.039653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.041269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.041269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.048246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ba5d799d-63b8-4265-bb27-975459e691c9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:25.054623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ba5d799d-63b8-4265-bb27-975459e691c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:25.161207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 812/1646] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:25.173771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.174543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.174704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.206102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:25.212562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:25.213947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:25.215522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:25.233701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 813/1647] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:25.239943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.259381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b6a56-b11e-4d75-a978-d9ddd2d24770 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.270420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.271933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.273745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.274151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.276362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:25.278986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.283352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.311192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 814/1648] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:25.315206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.336707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3dd6-f8a5-425a-8d27-4a197134866b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.339766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:25.341874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.342600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.342836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.343115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.344093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.346627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.377244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 835/1649] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:25.390747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.392565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:25.416643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 815/1650] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:25 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:25.421636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.422145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac97c3f-48e3-4fa1-9f8a-6429281ce618 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.568188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.569216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.569507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.574081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.604435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.606321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.615979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144f298-bfc5-4a0b-88f6-c99426ec7eab admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.624292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 836/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:25.625253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.627226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.627926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.628210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.628490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.630799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:25.632278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.640635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.684637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d060-343a-425c-80a4-1716a3f2eb73 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.691328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 816/1652] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:25 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:25.697646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.705244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.713258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.714611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.715576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] PATH_INFO: `/v3/users/096bc057113f484c9e15ae58cd12cd4a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.728020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf510d-ec32-48b4-9f16-e277f1a4274e admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.737362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.746055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.746311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.746616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.747668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.747916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096bc057113f484c9e15ae58cd12cd4a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.749780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.772129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 817/1653] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:25.779206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.783078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.811013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d5e2-5994-4681-a192-cab34aa8a29d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.833758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.834474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.834763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.835043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.835798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.837601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.876217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 818/1654] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:25.877296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:25.889712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096bc057113f484c9e15ae58cd12cd4a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:25.890916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b877d22-f4d5-4b24-b3af-b270fc34101e admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:25.912158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096bc057113f484c9e15ae58cd12cd4a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:25.912563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb38040-c9f3-4558-83d1-206b1400d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:25.920055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38040-c9f3-4558-83d1-206b1400d936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.920346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38040-c9f3-4558-83d1-206b1400d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.920615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb38040-c9f3-4558-83d1-206b1400d936 admin admin] PATH_INFO: `/v3/projects/ede12b3bad6041dfa97cf6d91e6d097b/users/6e23d1770f5d49cb8634649589fc75dd/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.926612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096bc057113f484c9e15ae58cd12cd4a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:25.928919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096bc057113f484c9e15ae58cd12cd4a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:25.944520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73709d3a-c5ed-4991-9bc9-6dde08beda11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096bc057113f484c9e15ae58cd12cd4a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:25.965908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 837/1655] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:25 2022] DELETE /identity/v3/users/096bc057113f484c9e15ae58cd12cd4a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:25.968041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:25.968336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:25.972337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:25.979087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb38040-c9f3-4558-83d1-206b1400d936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede12b3bad6041dfa97cf6d91e6d097b, user_id=6e23d1770f5d49cb8634649589fc75dd, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:25.988624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb38040-c9f3-4558-83d1-206b1400d936 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:25.998145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:26.028836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 819/1656] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:25 2022] PUT /identity/v3/projects/ede12b3bad6041dfa97cf6d91e6d097b/users/6e23d1770f5d49cb8634649589fc75dd/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:26.029070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:26.029070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:26.031104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.031870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.031967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.109592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] MFA Rules not processed for user `6e23d1770f5d49cb8634649589fc75dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:26.112496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:26.172227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 838/1657] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:26.194226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:26.197449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:26.216509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:26.294232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 820/1658] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:26.299669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:26.301970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:26.337174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7998f-7cb7-4314-996b-67f45b4af0d5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:26.342277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:26.343021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.343299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.343583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.344319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:26.346296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:26.397076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 821/1659] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:26 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:26.401202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:26.448757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4fe6c-bc7c-4c6b-a010-f641dcc24a97 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:26.628084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe511-f657-4fd0-96ee-23eab3be9d24 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:26.646696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:26.647813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.648300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.648743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.649704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:26.651928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:26.693608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 822/1660] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:26 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:26.698237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:26.715791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98113409-4b06-4836-bda2-5a27d9003da7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:26.740148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:26.740899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.741290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.744088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.745050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:26.750336 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:26.773969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 823/1661] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:26.774263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:26.779408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:26.782415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:26.783099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.783455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.783744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.809938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:26.811431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:26.835390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 839/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:26.836706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:26.852204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29cbf-338c-451b-9b1a-2c7d49a080ef service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:26.860572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699ce6e-8941-4840-9ba6-448eb109a202 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:26.874431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961db036-1fe2-4281-9a74-2308983ce19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:26.875343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961db036-1fe2-4281-9a74-2308983ce19f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.875626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961db036-1fe2-4281-9a74-2308983ce19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.875895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961db036-1fe2-4281-9a74-2308983ce19f admin admin] PATH_INFO: `/v3/projects/2c7bcafed44e4603bb65bc0fb7245d9d/users/5228a95fdf2e4614951003450985843b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.885722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:26.886812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.887102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.887381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] PATH_INFO: `/v3/users/ac77bdee7e0c40e69f40b510aed8258b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.889714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac77bdee7e0c40e69f40b510aed8258b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:26.890753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: WARNING py.warnings [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:54:26.890753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: warnings.warn(msg) Jul 05 20:54:26.890753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: Jul 05 20:54:26.891955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:26.914224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961db036-1fe2-4281-9a74-2308983ce19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7bcafed44e4603bb65bc0fb7245d9d, user_id=5228a95fdf2e4614951003450985843b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:26.917040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961db036-1fe2-4281-9a74-2308983ce19f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:26.939256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 840/1663] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:26 2022] PUT /identity/v3/projects/2c7bcafed44e4603bb65bc0fb7245d9d/users/5228a95fdf2e4614951003450985843b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:26.940733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e214-72f4-4e15-a8b7-016eab94fa98 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:26.941035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e214-72f4-4e15-a8b7-016eab94fa98 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:26.941315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34e214-72f4-4e15-a8b7-016eab94fa98 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:26.943924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 841/1664] 10.222.0.20 () {54 vars in 960 bytes} [Tue Jul 5 20:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:26.944724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34e214-72f4-4e15-a8b7-016eab94fa98 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:27.050577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:27.080023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac77bdee7e0c40e69f40b510aed8258b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:27.093092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34e214-72f4-4e15-a8b7-016eab94fa98 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:27.106824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ebb75-94f9-4bdc-9d9d-6147a5a32553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:27.107524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ebb75-94f9-4bdc-9d9d-6147a5a32553 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.107809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ebb75-94f9-4bdc-9d9d-6147a5a32553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.108087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ebb75-94f9-4bdc-9d9d-6147a5a32553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.108841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ebb75-94f9-4bdc-9d9d-6147a5a32553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:27.110486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ebb75-94f9-4bdc-9d9d-6147a5a32553 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:27.148505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac77bdee7e0c40e69f40b510aed8258b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:27.151643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 842/1665] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:27.163831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b826-db92-4df4-8ee5-365819285a86 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.164991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b826-db92-4df4-8ee5-365819285a86 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.166393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9b826-db92-4df4-8ee5-365819285a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.181456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac77bdee7e0c40e69f40b510aed8258b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:27.185214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac77bdee7e0c40e69f40b510aed8258b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:27.201708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac77bdee7e0c40e69f40b510aed8258b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:27.208403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-04e9b826-db92-4df4-8ee5-365819285a86 None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:27.211541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04e9b826-db92-4df4-8ee5-365819285a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.214804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 824/1666] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:26 2022] DELETE /identity/v3/users/ac77bdee7e0c40e69f40b510aed8258b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:27.216743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:27.218802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.300396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:27.382362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 843/1667] 10.222.0.20 () {58 vars in 1057 bytes} [Tue Jul 5 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:27.384987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.385285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.385569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.406920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47bb40-a52d-408a-aa37-67a83b151db2 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:27.422830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e542fd-9f0a-46a4-80ed-5f024cf9ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:27.424036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e542fd-9f0a-46a4-80ed-5f024cf9ac31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.424036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e542fd-9f0a-46a4-80ed-5f024cf9ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.424330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e542fd-9f0a-46a4-80ed-5f024cf9ac31 admin admin] PATH_INFO: `/v3/projects/2c7bcafed44e4603bb65bc0fb7245d9d/users/5228a95fdf2e4614951003450985843b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.428069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e542fd-9f0a-46a4-80ed-5f024cf9ac31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7bcafed44e4603bb65bc0fb7245d9d, user_id=5228a95fdf2e4614951003450985843b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:27.433369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:27.437524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.438927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e542fd-9f0a-46a4-80ed-5f024cf9ac31 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:27.453523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 844/1668] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:27.454460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:27.473846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 825/1669] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:27 2022] PUT /identity/v3/projects/2c7bcafed44e4603bb65bc0fb7245d9d/users/5228a95fdf2e4614951003450985843b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:27.485734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.486502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.487351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.499513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc885-c054-4bba-ac92-15a29bfb8494 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:27.542837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] MFA Rules not processed for user `5228a95fdf2e4614951003450985843b`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:27.546861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.696988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:27.698592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.698592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.698846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.707582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.756057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 826/1670] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:27.757196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:27.758984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.767725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:27.770914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:27.790015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 845/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:27.791082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:27.792538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:27.872877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:27.882963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55277355-d79e-4523-805f-fa4985a51f2f service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:27.889801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:27.892261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.892783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.893919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:27.926491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:27.928157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:27.949620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 846/1672] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:27.952538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada3106-b0e9-4515-951f-48f712bd97b6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:27.960567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:27.961280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:27.962400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:27.962683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:28.124202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:28.125717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:28.133128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:28.148423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27821741-4fa4-4576-b327-5ed41ec7c07b service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:28.151092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 827/1673] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:28.157390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:28.158060 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:28.158342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:28.158619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:28.164494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:28.318648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:28.320250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:28.333469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:28.343294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 847/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:29.059674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:29.062207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:29.093606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1d0e2-f0c0-4bda-9eaa-61760b2263a3 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:29.111490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:29.127489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:29.129165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:29.131405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.133439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.134160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] PATH_INFO: `/v3/projects/2936af0b060a40f386b4112e4f9f3cbe` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.140350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2936af0b060a40f386b4112e4f9f3cbe)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:29.150450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:29.167021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f403f-c85b-4f06-ae4d-234d25a0ad3e service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:29.179418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:29.182208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.183433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.184057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] PATH_INFO: `/v3/projects/ce0fdcac2fc84876bb72a68abaa107ab` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.188774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0fdcac2fc84876bb72a68abaa107ab)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:29.200703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:29.334747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0fdcac2fc84876bb72a68abaa107ab', 'request_id': 'req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.340741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2936af0b060a40f386b4112e4f9f3cbe', 'request_id': 'req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.350924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0fdcac2fc84876bb72a68abaa107ab', 'request_id': 'req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.355519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2936af0b060a40f386b4112e4f9f3cbe', 'request_id': 'req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.363560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0fdcac2fc84876bb72a68abaa107ab', 'request_id': 'req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.372102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2936af0b060a40f386b4112e4f9f3cbe', 'request_id': 'req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.390551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] The token cache is being invalidate because project ce0fdcac2fc84876bb72a68abaa107ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:29.391095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.392907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-582dad0d-3c83-4e3e-a6bc-7c1452bfaa2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.396964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] The token cache is being invalidate because project 2936af0b060a40f386b4112e4f9f3cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:29.397606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.398448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.400208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 848/1675] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:29 2022] DELETE /identity/v3/projects/ce0fdcac2fc84876bb72a68abaa107ab => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:29.406956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb9a3-6243-454b-a1db-1ab9770efcc2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.410549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb9a3-6243-454b-a1db-1ab9770efcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.410549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb9a3-6243-454b-a1db-1ab9770efcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.411876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 828/1676] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:29 2022] DELETE /identity/v3/projects/2936af0b060a40f386b4112e4f9f3cbe => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:29.413804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:29.421396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:29.468086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-db7eb9a3-6243-454b-a1db-1ab9770efcc2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:29.480146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-db7eb9a3-6243-454b-a1db-1ab9770efcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:29.592803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a9a6-4ed1-4e6a-abf2-b11a78ee416a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:29.603622 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:29.605000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.605490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.606348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] PATH_INFO: `/v3/users/ffd9ba2bf974470ebdcad7277b3c3ebb` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.608957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd9ba2bf974470ebdcad7277b3c3ebb)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:29.614754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:29.623499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:29.705678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 849/1677] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:29.714361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.714868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.715154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.758090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:29.759346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:29.795327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd9ba2bf974470ebdcad7277b3c3ebb'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.799978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 850/1678] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:29.803921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:29.832454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c8227-655c-4e5f-b330-665f7b9a4c55 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:29.856532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:29.857256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.857540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.857814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.858552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:29.858859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:29.860470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:29.867782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd9ba2bf974470ebdcad7277b3c3ebb'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.905569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 851/1679] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:29.906051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd9ba2bf974470ebdcad7277b3c3ebb'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.906500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:29.913199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd9ba2bf974470ebdcad7277b3c3ebb'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.937630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151df901-9fe3-4a95-8993-bcec71e99f24 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:29.956047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd9ba2bf974470ebdcad7277b3c3ebb'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:29.957285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:29.958771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:29.959670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:29.959958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:29.965135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:29.968509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:29.974812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 829/1680] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:29 2022] DELETE /identity/v3/users/ffd9ba2bf974470ebdcad7277b3c3ebb => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:30.092018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:30.092702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 852/1681] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:29 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:30.093697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:30.328057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc23df-b5c8-45cf-a4c8-b4dab7d9a341 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:30.408519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:30.409344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:30.409698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:30.410051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:30.411652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:30.413908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:30.442760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 830/1682] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:30 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:30.443956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:30.465783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28736c6-00fa-4e18-a34d-b722169d8986 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:30.476313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:30.477217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:30.477627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:30.478307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:30.479967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:30.482937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:30.499752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 853/1683] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:30.500970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:30.518274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7627698-0486-4622-8d6e-d59afd9ad85b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:30.538760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c98b0-1cd1-4a61-8001-acc10f27e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:30.539361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c98b0-1cd1-4a61-8001-acc10f27e7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:30.539574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c98b0-1cd1-4a61-8001-acc10f27e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:30.539847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c98b0-1cd1-4a61-8001-acc10f27e7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:30.540603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c98b0-1cd1-4a61-8001-acc10f27e7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:30.542345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c98b0-1cd1-4a61-8001-acc10f27e7f1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:30.565484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 831/1684] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:30.568136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:30.580082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0c4a7-86fd-4f7d-8163-bdb352b1f56b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:30.598775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:30.599751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:30.600044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:30.600327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] PATH_INFO: `/v3/projects/cc1ab9cbfa8a455f8802af5122b3daa0/users/8d661e8ac05f4e4d8d8cc806d47d8f51/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:30.631230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1ab9cbfa8a455f8802af5122b3daa0, user_id=8d661e8ac05f4e4d8d8cc806d47d8f51, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:30.634603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:30.689961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 854/1685] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:30 2022] PUT /identity/v3/projects/cc1ab9cbfa8a455f8802af5122b3daa0/users/8d661e8ac05f4e4d8d8cc806d47d8f51/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:30.701179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fd221-3f74-4f94-ac86-23771c2968e4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:30.701370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fd221-3f74-4f94-ac86-23771c2968e4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:30.702366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fd221-3f74-4f94-ac86-23771c2968e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:30.746175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:30.782181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0d9fd221-3f74-4f94-ac86-23771c2968e4 None None] MFA Rules not processed for user `8d661e8ac05f4e4d8d8cc806d47d8f51`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:30.786335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0d9fd221-3f74-4f94-ac86-23771c2968e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:31.056884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 832/1686] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:31.071364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:31.073007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:31.088030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:31.241011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb06670-1c84-441c-b271-6e6b64bdfba9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:31.250497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:31.251656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:31.252367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:31.252845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:31.273143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:31.275745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:31.309487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 855/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:31.374872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:31.375360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:31.375708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:31.449414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:31.451224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:31.473233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] MFA Rules not processed for user `5eac41ce3f04450b840cff305ec1a5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:31.476228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:31.711253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ea917-d002-43ac-aa44-c34cb785ec1d service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:31.733443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:31.734486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:31.734887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:31.735293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] PATH_INFO: `/v3/users/988c73656593483994c53b80cb5ddbb1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:31.738594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 833/1688] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:31.738779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] RBAC: Authorizing `identity:delete_user(user_id=988c73656593483994c53b80cb5ddbb1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:31.740251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:31.741957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:31.742073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:31.772903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd3efa-b0cc-45dc-980c-9a8dee646a5d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:31.795194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:31.796732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:31.797089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:31.797458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] PATH_INFO: `/v3/projects/321f64fa1cd44391b87eefcb677d1747` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:31.802529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=321f64fa1cd44391b87eefcb677d1747)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:31.810146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:31.882463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988c73656593483994c53b80cb5ddbb1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.933975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988c73656593483994c53b80cb5ddbb1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.954690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988c73656593483994c53b80cb5ddbb1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.958618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988c73656593483994c53b80cb5ddbb1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.960670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321f64fa1cd44391b87eefcb677d1747', 'request_id': 'req-21fb84c0-c0be-4e13-b252-524f0d888bb7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.976659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321f64fa1cd44391b87eefcb677d1747', 'request_id': 'req-21fb84c0-c0be-4e13-b252-524f0d888bb7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.977013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988c73656593483994c53b80cb5ddbb1'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:31.991597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 856/1689] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:31 2022] DELETE /identity/v3/users/988c73656593483994c53b80cb5ddbb1 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:31.992638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:31.994546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:31.996641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321f64fa1cd44391b87eefcb677d1747', 'request_id': 'req-21fb84c0-c0be-4e13-b252-524f0d888bb7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.016289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] The token cache is being invalidate because project 321f64fa1cd44391b87eefcb677d1747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:32.016582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.019949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.029322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 834/1690] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:31 2022] DELETE /identity/v3/projects/321f64fa1cd44391b87eefcb677d1747 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:32.030127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:32.035270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.037976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:32.068305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:32.185094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e325fb-b1a7-4b5c-bd3d-55cf71af481f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:32.201465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:32.202141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.202420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.202693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.210169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.234627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb84c0-c0be-4e13-b252-524f0d888bb7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:32.355730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:32.357815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cde4c7-0376-4b3e-a381-bcd939767d71 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:32.380356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 857/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:32.381909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321087-bdff-4946-bf2a-d2b01779f643 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.384499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321087-bdff-4946-bf2a-d2b01779f643 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.385219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321087-bdff-4946-bf2a-d2b01779f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.408229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:32.411165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.412203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.412525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] PATH_INFO: `/v3/users/8d661e8ac05f4e4d8d8cc806d47d8f51` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.418256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d661e8ac05f4e4d8d8cc806d47d8f51)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:32.426227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e7321087-bdff-4946-bf2a-d2b01779f643 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:32.428778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:32.430755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e7321087-bdff-4946-bf2a-d2b01779f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.600866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d661e8ac05f4e4d8d8cc806d47d8f51'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.601169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 858/1692] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:32.604470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e7da8-7e7c-4559-a314-e5219ab5f872 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.610881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e7da8-7e7c-4559-a314-e5219ab5f872 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.611355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e7da8-7e7c-4559-a314-e5219ab5f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.654255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9b2e7da8-7e7c-4559-a314-e5219ab5f872 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:32.655163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d661e8ac05f4e4d8d8cc806d47d8f51'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.655904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9b2e7da8-7e7c-4559-a314-e5219ab5f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.687897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 859/1693] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:32.689571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91a55-daba-427f-a590-30b62580314d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.690202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91a55-daba-427f-a590-30b62580314d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.690584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91a55-daba-427f-a590-30b62580314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.696826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d661e8ac05f4e4d8d8cc806d47d8f51'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.698264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d661e8ac05f4e4d8d8cc806d47d8f51'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.719381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d661e8ac05f4e4d8d8cc806d47d8f51'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.735637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 835/1694] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:32 2022] DELETE /identity/v3/users/8d661e8ac05f4e4d8d8cc806d47d8f51 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:32.737431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:32.740909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.758311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bbd91a55-daba-427f-a590-30b62580314d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:32.758928 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bbd91a55-daba-427f-a590-30b62580314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.950821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:32.976500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:32.992444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3de4-d379-4a5c-9a74-7edc077d1409 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.005565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.006395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.006740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.007093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.015329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.047224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 860/1695] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:33.057719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.058376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.058974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.109952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:33.111366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.143369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 861/1696] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:33.144022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.148622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.234876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.236668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d778e-1cec-4006-8a8d-e0e7fcd7806d service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.265027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 836/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:33.268357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.268710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.271543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.345248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:33.347790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.355519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6ce2-bcfa-4cd0-b5c9-ee35e80ff0b6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.366260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 837/1698] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:33.366260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.372258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.373067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.373356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.373757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.377597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.399842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e095d-0f55-4cca-b02a-ad98f0a2a6b2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.408306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.409889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.410748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.411727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.437713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.439930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.470571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 838/1699] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:33.473047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.497390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc942a-0119-4100-a067-248f92fe79a7 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.509613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.511130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.512532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.512958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.513993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:33.515154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.517153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.534885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.538320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.546730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 839/1700] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:33.552537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.561825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 862/1701] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:33.571442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7027b7-36c6-461d-85f5-2ce307e6b6ca admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.577441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.578283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.578926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.580759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.581647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.584660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.627981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 840/1702] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:33.633631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.675411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e9832-6f72-402f-ae9c-c25721e2dc63 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.833890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.834949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.834949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.835296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.836014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.838149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.875565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 863/1703] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:33.882606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.932242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95278433-45d7-403a-a59b-af8ef7640aa3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.985673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.986495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.992713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.998531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:34.000942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:34.019588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:34.085928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 841/1704] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:34.090615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:34.108545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0fc3b-8e31-44db-9136-c8482907d18a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:34.119710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62b4fb-8c80-4a2a-981d-7c244ae0b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:34.120419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62b4fb-8c80-4a2a-981d-7c244ae0b284 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:34.120705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62b4fb-8c80-4a2a-981d-7c244ae0b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:34.121202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62b4fb-8c80-4a2a-981d-7c244ae0b284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:34.122590 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62b4fb-8c80-4a2a-981d-7c244ae0b284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:34.131453 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62b4fb-8c80-4a2a-981d-7c244ae0b284 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:34.141367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:34.155292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 864/1705] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:34.160168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:34.196492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014c8db-210b-4f66-9b11-c931a066a2f4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:34.245166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:34.251174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:34.252953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:34.262195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] PATH_INFO: `/v3/projects/e3596627a71e494dadc229f62267dd1c/users/ca228deed6a247c99ba222440f64729e/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:34.337059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3596627a71e494dadc229f62267dd1c, user_id=ca228deed6a247c99ba222440f64729e, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:34.342728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:34.389520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 842/1706] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:34 2022] PUT /identity/v3/projects/e3596627a71e494dadc229f62267dd1c/users/ca228deed6a247c99ba222440f64729e/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:54:34.410528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:34.410528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:34.410528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:34.497033 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] MFA Rules not processed for user `ca228deed6a247c99ba222440f64729e`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:34.499315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:34.728279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 865/1707] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:34.732978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:34.991257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:35.001275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc45cda-a17f-4968-88c2-375f1441b770 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:35.031681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:35.032753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:35.033334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:35.033851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:35.034905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:35.038994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:35.142917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 843/1708] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:34 2022] POST /identity/v3/projects => generated 367 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:35.147615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:35.168674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666855d-12a8-44f6-9af3-3b0c6be1cad4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:35.369750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:35.370628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:35.371015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:35.371394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:35.372211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:35.374324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:35.453182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:35.459483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 866/1709] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:35 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:35.467889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eb7c4-533f-4404-bfa0-e50436c93858 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:35.482333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:35.483664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:35.484155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:35.484639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:35.485624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:35.487506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:35.526080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:35.539083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829da50-d030-4ebd-a953-f323d3407a9a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:35.539990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 844/1710] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:35.559268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:35.560584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:35.561123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:35.561601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] PATH_INFO: `/v3/projects/1d3f4cb22e2f4952a2ddeda5eb07cd76/users/c4672995f3714ff59b7f2d384077ceaf/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:35.591166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3f4cb22e2f4952a2ddeda5eb07cd76, user_id=c4672995f3714ff59b7f2d384077ceaf, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:35.594942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:35.632119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 867/1711] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:35 2022] PUT /identity/v3/projects/1d3f4cb22e2f4952a2ddeda5eb07cd76/users/c4672995f3714ff59b7f2d384077ceaf/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:35.634211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:35.654908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:35.655845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c9117-6c92-4cac-9ce1-0e2116fd9020 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:35.656727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:35.813293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:35.824204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fa7cf-54a8-4838-9eb8-c1ac154dba06 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:35.827866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:35.828487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:35.828740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:35.834279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:35.837963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:35.838156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:35.838847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:35.839697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:35.839697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] PATH_INFO: `/v3/projects/dd927c646e744d0085f21250438a5200` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:35.840004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:35.844313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd927c646e744d0085f21250438a5200)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:35.846300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:35.911212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 845/1712] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:35.915833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:35.970409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243df88-0d68-4cd4-996d-d66fa68e4c1a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:36.007223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd927c646e744d0085f21250438a5200', 'request_id': 'req-9d3e3914-68e1-450c-adfc-24ab07c8df84'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:36.043834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd927c646e744d0085f21250438a5200', 'request_id': 'req-9d3e3914-68e1-450c-adfc-24ab07c8df84'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:36.055200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd927c646e744d0085f21250438a5200', 'request_id': 'req-9d3e3914-68e1-450c-adfc-24ab07c8df84'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:36.087845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] The token cache is being invalidate because project dd927c646e744d0085f21250438a5200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:36.088235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:36.088780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9d3e3914-68e1-450c-adfc-24ab07c8df84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:36.090683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 868/1713] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:35 2022] DELETE /identity/v3/projects/dd927c646e744d0085f21250438a5200 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:54:36.095430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e2279-bd12-4112-9661-193d6673cc34 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:36.095867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e2279-bd12-4112-9661-193d6673cc34 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:36.096145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e2279-bd12-4112-9661-193d6673cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:36.148196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-107e2279-bd12-4112-9661-193d6673cc34 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:36.149558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-107e2279-bd12-4112-9661-193d6673cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:36.225518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bfd9c-d4ce-45bd-89f5-d882640a0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:36.227486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bfd9c-d4ce-45bd-89f5-d882640a0036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:36.229189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bfd9c-d4ce-45bd-89f5-d882640a0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:36.231264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bfd9c-d4ce-45bd-89f5-d882640a0036 admin admin] PATH_INFO: `/v3/projects/1d3f4cb22e2f4952a2ddeda5eb07cd76/users/c4672995f3714ff59b7f2d384077ceaf/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:36.236670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bfd9c-d4ce-45bd-89f5-d882640a0036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3f4cb22e2f4952a2ddeda5eb07cd76, user_id=c4672995f3714ff59b7f2d384077ceaf, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:36.246623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bfd9c-d4ce-45bd-89f5-d882640a0036 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:36.279913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 846/1714] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:35 2022] PUT /identity/v3/projects/1d3f4cb22e2f4952a2ddeda5eb07cd76/users/c4672995f3714ff59b7f2d384077ceaf/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:36.294930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:36.295418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:36.295805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:36.318985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 869/1715] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:36.326378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:36.326932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:36.327706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:36.391721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] MFA Rules not processed for user `c4672995f3714ff59b7f2d384077ceaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:36.401302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:36.401533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:36.402853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:36.586964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:36.653421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 870/1716] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:36.655358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:36.658404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 847/1717] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:36.663649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:36.673406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:36.713656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b49bb3-f0f2-4b55-9aa3-2ba752527bcf None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:36.732012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:36.732979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:36.735664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:36.736840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] PATH_INFO: `/v3/projects/cc1ab9cbfa8a455f8802af5122b3daa0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:36.740065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1ab9cbfa8a455f8802af5122b3daa0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:36.742397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:36.745912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ad1c7-6df9-4235-9f86-860412598383 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:36.782941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:36.783795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:36.784251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:36.784642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:36.785680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:36.787844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:36.799789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:36.844112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 848/1718] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:36.848839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:36.856200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:36.862899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:36.982731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1ab9cbfa8a455f8802af5122b3daa0', 'request_id': 'req-abb850cd-2f44-438d-94cd-6e1391f71bcd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:37.015305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1ab9cbfa8a455f8802af5122b3daa0', 'request_id': 'req-abb850cd-2f44-438d-94cd-6e1391f71bcd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:37.054553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1ab9cbfa8a455f8802af5122b3daa0', 'request_id': 'req-abb850cd-2f44-438d-94cd-6e1391f71bcd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:37.110283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] The token cache is being invalidate because project cc1ab9cbfa8a455f8802af5122b3daa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:37.110591 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:37.113211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:37.120921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 871/1719] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:36 2022] DELETE /identity/v3/projects/cc1ab9cbfa8a455f8802af5122b3daa0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:37.123482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:37.136795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:37.167182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12308d5c-ec1d-4fe3-9b30-d4167027fb27 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:37.347294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb850cd-2f44-438d-94cd-6e1391f71bcd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:37.362754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1caa2f-007f-45a0-bd90-2f12b5b938f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:37.365645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1caa2f-007f-45a0-bd90-2f12b5b938f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:37.365947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1caa2f-007f-45a0-bd90-2f12b5b938f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:37.366307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1caa2f-007f-45a0-bd90-2f12b5b938f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:37.368342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1caa2f-007f-45a0-bd90-2f12b5b938f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:37.372653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1caa2f-007f-45a0-bd90-2f12b5b938f2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:37.380428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:37.388916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:37.391262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:37.393638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:37.398925 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:37.444325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 872/1720] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:37 2022] POST /identity/v3/projects => generated 381 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:37.447257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3681776-3ec5-4668-ba06-6bb0749de4d5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:37.448304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3681776-3ec5-4668-ba06-6bb0749de4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:37.449205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3681776-3ec5-4668-ba06-6bb0749de4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:37.508219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a3681776-3ec5-4668-ba06-6bb0749de4d5 None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:37.511051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a3681776-3ec5-4668-ba06-6bb0749de4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:37.644550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 873/1721] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jul 5 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:37.646963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:37.647259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:37.647542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:37.659445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:37.661235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:37.677418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:37.678998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:37.679787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 849/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:37.681086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:37.725802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040c921-eeae-4c89-80e1-6d977c821db8 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:37.901498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:37.947433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:37.980183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:37.982351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:37.983403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:37.983698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:37.984416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:37.991172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.042128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 850/1723] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:37 2022] POST /identity/v3/users => generated 291 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:38.042128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.050472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:38.068622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 874/1724] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:38.073214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.077714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:38.078985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c9f70-a12e-4cc4-8748-296763172441 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.097316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a0ec-c18e-4b67-81f2-a475c333c0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.098438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a0ec-c18e-4b67-81f2-a475c333c0dc service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.098899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a0ec-c18e-4b67-81f2-a475c333c0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.099367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a0ec-c18e-4b67-81f2-a475c333c0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.121661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a0ec-c18e-4b67-81f2-a475c333c0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.123146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a0ec-c18e-4b67-81f2-a475c333c0dc service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.161678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 851/1725] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:38.165266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.167320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.168216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.226139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] MFA Rules not processed for user `5eac41ce3f04450b840cff305ec1a5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:38.227325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:38.236434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c59fc-e0f7-48c0-aeeb-ffc6f59f0601 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.248588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.250455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.250744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.252565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.257254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:38.425887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 852/1726] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:38.427375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.440324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c39a3-75e5-4dc3-9b27-c6cbeb8d8c1b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.447581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce76c98-9e04-4a47-8d14-a2dd4ff0e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.449147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce76c98-9e04-4a47-8d14-a2dd4ff0e5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.449433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce76c98-9e04-4a47-8d14-a2dd4ff0e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.449714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce76c98-9e04-4a47-8d14-a2dd4ff0e5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.450463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce76c98-9e04-4a47-8d14-a2dd4ff0e5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.452899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce76c98-9e04-4a47-8d14-a2dd4ff0e5bb admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.472838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 853/1727] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:38.475688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.476144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.477103 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.504427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:38.506289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:38.523557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 854/1728] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:38.524590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.530219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.533085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.549210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6e58-f107-4bcb-b553-a310f5a46103 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.563365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.566115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.566413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.568546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.569823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.571714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.582212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 875/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:38.584736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.618612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 855/1730] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:38.621416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.636076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d19a80-5f64-4b53-a0dd-f5554d20c0ca service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.646679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961d4b3-ba6c-4c42-9516-f179861cd42a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.655649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.657000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.659729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.660193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.662042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:38.662545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.664379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5fc71-ffcf-46ad-9c17-cb338334435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.665344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fc71-ffcf-46ad-9c17-cb338334435b admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.665646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fc71-ffcf-46ad-9c17-cb338334435b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.665905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5fc71-ffcf-46ad-9c17-cb338334435b admin admin] PATH_INFO: `/v3/projects/f1bc1a49abeb4fe3957daa284884b32b/users/897ea6bf46a74c70b2f8bd40573d691f/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.668098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.710536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 876/1731] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:38.714915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.720627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fc71-ffcf-46ad-9c17-cb338334435b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bc1a49abeb4fe3957daa284884b32b, user_id=897ea6bf46a74c70b2f8bd40573d691f, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.729007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5fc71-ffcf-46ad-9c17-cb338334435b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.750833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74012e6a-51b9-4101-9bc5-e43db129f95f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:38.765713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:38.766905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.768478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.772456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.773863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:38.778262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 856/1732] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:38 2022] PUT /identity/v3/projects/f1bc1a49abeb4fe3957daa284884b32b/users/897ea6bf46a74c70b2f8bd40573d691f/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:38.779011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:38.790114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:38.790899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:38.791767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:38.879073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 877/1733] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:38.883960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:38.886725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] MFA Rules not processed for user `897ea6bf46a74c70b2f8bd40573d691f`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:38.888414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:39.159579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb97cf-71fe-485f-bc76-23a901119d0d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.169455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:39.192913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.194950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.196009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.196485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.199218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.201301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.201670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 857/1734] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:39.205212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.234560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacb9d4-1eda-4467-933c-020b0b94ece8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.239054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:39.251408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.253999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.255740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.257194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.258112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.269555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.274095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 878/1735] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:38 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:39.278242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.318664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86adf4-0ce3-4489-95f9-1846cc6fc280 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.335585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.338502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.338502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.338502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.338502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.353750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.361990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 858/1736] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:39 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:39.367834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.389032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 879/1737] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:39.391384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.419532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e4ac9-c720-4f77-ad20-00880d384dc3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.592661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f28b4a-592e-45cc-8a7a-18e49c608564 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.606562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df291f-0a02-47a8-941a-0da11170a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.607725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df291f-0a02-47a8-941a-0da11170a426 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.608083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df291f-0a02-47a8-941a-0da11170a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.608501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df291f-0a02-47a8-941a-0da11170a426 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.609326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df291f-0a02-47a8-941a-0da11170a426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.612154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df291f-0a02-47a8-941a-0da11170a426 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.648746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.652036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.652178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.652783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.653654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.654429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 859/1738] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:39 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:39.655402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.658724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3f8b-1aff-46a8-9ea0-79f2223c8f7a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.659786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3f8b-1aff-46a8-9ea0-79f2223c8f7a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.661181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e3f8b-1aff-46a8-9ea0-79f2223c8f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.685514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 880/1739] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:39.686325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.724957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9177f22-9367-4a7d-843e-b9c3ecebf314 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.742698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.743459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.744041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.744338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.745176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.747408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.748672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-207e3f8b-1aff-46a8-9ea0-79f2223c8f7a None None] MFA Rules not processed for user `d152763a64794301b21587ab2b395bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:39.752450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-207e3f8b-1aff-46a8-9ea0-79f2223c8f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:39.783926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 881/1740] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:39.786295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.812656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b626330-1ce8-41ff-8a39-f43d07362fd3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:39.828158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:39.829761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.830741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.831229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] PATH_INFO: `/v3/projects/d1da1204932b471a9c33a331e291dc31/users/708121f67c3b486b9e10b286337213a8/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:39.883945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1da1204932b471a9c33a331e291dc31, user_id=708121f67c3b486b9e10b286337213a8, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:39.896079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:39.927948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 882/1741] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:39 2022] PUT /identity/v3/projects/d1da1204932b471a9c33a331e291dc31/users/708121f67c3b486b9e10b286337213a8/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:39.930986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:39.994601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 860/1742] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:39.996501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:39.997148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:39.997646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.064691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] MFA Rules not processed for user `708121f67c3b486b9e10b286337213a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:40.079039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:40.183833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94539ee6-a327-463a-8ace-fe5aa9f7cd22 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:40.209850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96457-d8a2-4675-b0cc-0c7efe254907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:40.218760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96457-d8a2-4675-b0cc-0c7efe254907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:40.218760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96457-d8a2-4675-b0cc-0c7efe254907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:40.219026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96457-d8a2-4675-b0cc-0c7efe254907 admin admin] PATH_INFO: `/v3/projects/95073951e05b4f0f82bfdafbe492268f/users/ea88e5a638ef4b98ba17c21de6189473/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.296383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:40.304254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a96457-d8a2-4675-b0cc-0c7efe254907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95073951e05b4f0f82bfdafbe492268f, user_id=ea88e5a638ef4b98ba17c21de6189473, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:40.307076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a96457-d8a2-4675-b0cc-0c7efe254907 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:40.342602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 883/1743] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:39 2022] PUT /identity/v3/projects/95073951e05b4f0f82bfdafbe492268f/users/ea88e5a638ef4b98ba17c21de6189473/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:40.343729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:40.344020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:40.344299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.352670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 861/1744] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:40.353597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:40.392602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd340b8a-7a6f-4c51-9d8f-95f900e5182c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:40.406081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] MFA Rules not processed for user `d152763a64794301b21587ab2b395bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:40.407327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:40.500215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:40.633444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:40.634078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 884/1745] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:40.634254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:40.635323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:40.636140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:40.636428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.638572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:40.653066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:40.677318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 862/1746] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:40.678486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75b9c-8f4d-4dee-804f-0722326de015 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:40.681533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:40.691426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:40.696141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:40.697472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:40.697969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.701317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:40.704316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:40.710594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378bc99-01e3-4a80-8a34-3eb80f33b0a7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:40.723560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63876fae-d21d-473b-9de9-8a1098977707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:40.725243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876fae-d21d-473b-9de9-8a1098977707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:40.725688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876fae-d21d-473b-9de9-8a1098977707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:40.726124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876fae-d21d-473b-9de9-8a1098977707 admin admin] PATH_INFO: `/v3/projects/95073951e05b4f0f82bfdafbe492268f/users/ea88e5a638ef4b98ba17c21de6189473/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.728684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63876fae-d21d-473b-9de9-8a1098977707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95073951e05b4f0f82bfdafbe492268f, user_id=ea88e5a638ef4b98ba17c21de6189473, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:40.732212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63876fae-d21d-473b-9de9-8a1098977707 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:40.756449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 863/1747] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:40 2022] PUT /identity/v3/projects/95073951e05b4f0f82bfdafbe492268f/users/ea88e5a638ef4b98ba17c21de6189473/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:40.786691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:40.786691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:40.786691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:40.814291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 885/1748] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:40 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:40.815356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:40.831131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:40.832098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] MFA Rules not processed for user `ea88e5a638ef4b98ba17c21de6189473`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:40.834668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:41.106487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37280a6-c03c-46f8-8fef-a211f6d74a70 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:41.123710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3e33c-04a1-416b-8cd3-3328c3d40759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:41.124462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3e33c-04a1-416b-8cd3-3328c3d40759 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.124640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3e33c-04a1-416b-8cd3-3328c3d40759 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.127152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3e33c-04a1-416b-8cd3-3328c3d40759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.131990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 864/1749] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:41.133661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:41.306622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3e33c-04a1-416b-8cd3-3328c3d40759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:41.310531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3e33c-04a1-416b-8cd3-3328c3d40759 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:41.339758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:41.346336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 886/1750] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:41.351285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab8d1-5af9-4058-8423-15d6d1501763 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.352006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab8d1-5af9-4058-8423-15d6d1501763 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.352006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab8d1-5af9-4058-8423-15d6d1501763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.379403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04362567-1f5a-4daa-b396-0e7fc7594ca7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:41.400042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:41.400955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.401929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.406905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.408063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:41.410509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:41.442383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-782ab8d1-5af9-4058-8423-15d6d1501763 None None] MFA Rules not processed for user `a3792881ae73408db651dd6eb09b3d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:41.449541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-782ab8d1-5af9-4058-8423-15d6d1501763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:41.512070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 865/1751] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:41 2022] POST /identity/v3/users => generated 292 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:41.517082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:41.522954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:41.658761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:41.815437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 887/1752] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:41.818157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88334cc2-336d-4943-a97e-885535c59c5a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:41.819832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee70361-d981-4a64-8ed6-a8672c757ee9 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.820130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee70361-d981-4a64-8ed6-a8672c757ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.820407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee70361-d981-4a64-8ed6-a8672c757ee9 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.824038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 888/1753] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 5 20:54:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:41.824821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee70361-d981-4a64-8ed6-a8672c757ee9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:41.827423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:41.835547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.835547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.835547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.857800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:41.859451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee70361-d981-4a64-8ed6-a8672c757ee9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:41.862264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:41.873480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e0da-927d-42b8-8b4b-888824c09ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:41.874168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e0da-927d-42b8-8b4b-888824c09ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.874451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e0da-927d-42b8-8b4b-888824c09ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.875894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e0da-927d-42b8-8b4b-888824c09ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.876653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1e0da-927d-42b8-8b4b-888824c09ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:41.881107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1e0da-927d-42b8-8b4b-888824c09ef4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:41.906050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 889/1754] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:41.907853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:41.908094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:41.908356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:41.951678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 866/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:41.955039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:41.957247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:41.957395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.018089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea91361-6614-4017-8fa5-647b27592b6a service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.044675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.046193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.046714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.047252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] PATH_INFO: `/v3/projects/9b4ac880ab4e4a46993bf9f32153e76b/users/7c41d6c4eaa34004a45d3d1f9e4ea7e2/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.114111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4ac880ab4e4a46993bf9f32153e76b, user_id=7c41d6c4eaa34004a45d3d1f9e4ea7e2, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.117164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.149054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 890/1756] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:42.158820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 867/1757] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:41 2022] PUT /identity/v3/projects/9b4ac880ab4e4a46993bf9f32153e76b/users/7c41d6c4eaa34004a45d3d1f9e4ea7e2/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:42.162845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.195019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc316d4-2a92-47ea-9d38-153ba6e5e8d3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.264741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.393057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.393759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.394029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.394303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.402194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.404906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.438805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 891/1758] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:42.450600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.464712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf17da-572f-45a5-b170-594c38693cb9 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.474779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.476292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.478593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.482175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.637021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.639032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.650525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad14f-5987-43a0-88d2-05298aa7d55c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.667778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 868/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:42.679560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208cb6-0ec7-49de-ab35-38fa8199c224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.680322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208cb6-0ec7-49de-ab35-38fa8199c224 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.680439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.680613 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208cb6-0ec7-49de-ab35-38fa8199c224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.680885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208cb6-0ec7-49de-ab35-38fa8199c224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.701020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208cb6-0ec7-49de-ab35-38fa8199c224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.705875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208cb6-0ec7-49de-ab35-38fa8199c224 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.740595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 892/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:42.747252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886acbd-4c09-4ad7-956d-891fe0bfa90a service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.798618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b720230-6fb1-42ec-b905-67db5ee9c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.803582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720230-6fb1-42ec-b905-67db5ee9c497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.803924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720230-6fb1-42ec-b905-67db5ee9c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.804342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720230-6fb1-42ec-b905-67db5ee9c497 admin admin] PATH_INFO: `/v3/projects/9b4ac880ab4e4a46993bf9f32153e76b/users/7c41d6c4eaa34004a45d3d1f9e4ea7e2/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.816286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b720230-6fb1-42ec-b905-67db5ee9c497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4ac880ab4e4a46993bf9f32153e76b, user_id=7c41d6c4eaa34004a45d3d1f9e4ea7e2, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.842570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b720230-6fb1-42ec-b905-67db5ee9c497 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.885174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46226db4-c18d-448b-b4de-58d321545a57 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.885174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46226db4-c18d-448b-b4de-58d321545a57 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.885461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46226db4-c18d-448b-b4de-58d321545a57 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.887091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 893/1761] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:42.920656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 869/1762] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:42 2022] PUT /identity/v3/projects/9b4ac880ab4e4a46993bf9f32153e76b/users/7c41d6c4eaa34004a45d3d1f9e4ea7e2/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:42.922172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.922483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.922769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.929666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de416a60-14e3-4cad-a06c-c42df3bb6ddc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.930558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de416a60-14e3-4cad-a06c-c42df3bb6ddc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.934675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de416a60-14e3-4cad-a06c-c42df3bb6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.978194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:43.003132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:43.009895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] MFA Rules not processed for user `7c41d6c4eaa34004a45d3d1f9e4ea7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:43.011683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:43.058881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-de416a60-14e3-4cad-a06c-c42df3bb6ddc None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:43.060353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-de416a60-14e3-4cad-a06c-c42df3bb6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:43.135995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 894/1763] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:43.199607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:43.379795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5ab3-e31a-4b76-8b46-7b1bc5ecb722 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:43.385270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:43.385952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:43.386239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:43.386833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:43.402033 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:43.405179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:43.419942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 895/1764] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:43.442838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 870/1765] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:44.821493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:45.012256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b21025-cb64-47dd-b25a-77f2b708646f service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:45.026531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:45.029392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:45.029701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:45.032008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] PATH_INFO: `/v3/users/708121f67c3b486b9e10b286337213a8` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:45.037088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] RBAC: Authorizing `identity:delete_user(user_id=708121f67c3b486b9e10b286337213a8)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:45.042513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:45.171282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:45.182737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708121f67c3b486b9e10b286337213a8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:45.219446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708121f67c3b486b9e10b286337213a8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:45.240805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708121f67c3b486b9e10b286337213a8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:45.244270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708121f67c3b486b9e10b286337213a8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:45.259045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708121f67c3b486b9e10b286337213a8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:45.288086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 896/1766] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:44 2022] DELETE /identity/v3/users/708121f67c3b486b9e10b286337213a8 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:45.301188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:45.302040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:45.302345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:45.342683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:45.345640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:45.570009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 871/1767] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:45.578905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:45.580338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:45.765909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc2d0-2e11-41b6-bafb-be9774d9355f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:45.783915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:45.785751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:45.786640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:45.787627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:45.820073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:45.825422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:45.862927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 897/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:46.238967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:46.240748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:46.591380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e63a5b-d4a1-4987-b5c3-6e4e2f8bee7a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:46.616782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:46.619034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:46.635337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:46.636038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:46.636344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:46.636607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:46.641792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:46.658755 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b8098-ac77-48e9-9eec-9fa8d385835b service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:46.690488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:46.691390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:46.692039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:46.693506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:46.698451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:46.806937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:46.810686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:46.812975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:46.868996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 898/1769] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:46.870114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:46.881714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:46.914585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:46.917361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:46.930745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ed501-4837-4039-aee6-ef7cac347c96 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:46.952151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:46.952387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 872/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:46.970038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:46.970038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:46.970038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] PATH_INFO: `/v3/projects/d1da1204932b471a9c33a331e291dc31` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:46.976731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1da1204932b471a9c33a331e291dc31)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:46.986930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:47.194176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1da1204932b471a9c33a331e291dc31', 'request_id': 'req-3b7afef4-e95c-406b-aa4e-3536732aa529'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:47.217994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1da1204932b471a9c33a331e291dc31', 'request_id': 'req-3b7afef4-e95c-406b-aa4e-3536732aa529'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:47.275060 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1da1204932b471a9c33a331e291dc31', 'request_id': 'req-3b7afef4-e95c-406b-aa4e-3536732aa529'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:47.331152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] The token cache is being invalidate because project d1da1204932b471a9c33a331e291dc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:47.333369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:47.335136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3b7afef4-e95c-406b-aa4e-3536732aa529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:47.345049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 899/1771] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:46 2022] DELETE /identity/v3/projects/d1da1204932b471a9c33a331e291dc31 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:47.350150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:47.386636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dd381-f034-4216-a71e-72068451d706 service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:47.528495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:47.529308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:47.529915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:47.585697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] MFA Rules not processed for user `d152763a64794301b21587ab2b395bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:47.590972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:47.651656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:47.653515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:47.665843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:47.667565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] PATH_INFO: `/v3/users/7c41d6c4eaa34004a45d3d1f9e4ea7e2` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:47.672517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c41d6c4eaa34004a45d3d1f9e4ea7e2)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:47.678173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:47.735689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:47.850295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 900/1772] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:47.854217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:47.875698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:47.917765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c41d6c4eaa34004a45d3d1f9e4ea7e2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:47.933595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fea8c-19fd-47d8-9dcc-59ae7e8db587 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:47.948954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:47.949943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:47.950237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:47.950520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] PATH_INFO: `/v3/users/ca228deed6a247c99ba222440f64729e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:47.953855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca228deed6a247c99ba222440f64729e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:47.959161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:47.991881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c41d6c4eaa34004a45d3d1f9e4ea7e2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.039602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c41d6c4eaa34004a45d3d1f9e4ea7e2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.041425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c41d6c4eaa34004a45d3d1f9e4ea7e2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.070950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f128eb1-17ad-462e-82db-3a90cb884796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c41d6c4eaa34004a45d3d1f9e4ea7e2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.107384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 873/1773] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:47 2022] DELETE /identity/v3/users/7c41d6c4eaa34004a45d3d1f9e4ea7e2 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:54:48.136402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca228deed6a247c99ba222440f64729e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.155691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca228deed6a247c99ba222440f64729e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.170293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca228deed6a247c99ba222440f64729e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.171882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca228deed6a247c99ba222440f64729e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.185126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca228deed6a247c99ba222440f64729e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.195582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 901/1774] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:47 2022] DELETE /identity/v3/users/ca228deed6a247c99ba222440f64729e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:48.200017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:48.200297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:48.201341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:48.258803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:48.263327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:48.386895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:48.449270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 874/1775] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:48.481866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:48.483768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:48.646753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474356ee-74fd-4b54-b1b7-6bfede5a26af admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:48.651235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4599f5b-2cf3-4f2f-8a9a-7b1ab36cc6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:48.651904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4599f5b-2cf3-4f2f-8a9a-7b1ab36cc6aa service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:48.652715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4599f5b-2cf3-4f2f-8a9a-7b1ab36cc6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:48.653028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4599f5b-2cf3-4f2f-8a9a-7b1ab36cc6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:48.665480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4599f5b-2cf3-4f2f-8a9a-7b1ab36cc6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:48.667149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4599f5b-2cf3-4f2f-8a9a-7b1ab36cc6aa service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:48.697423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 902/1776] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:48.934831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:48.936286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:48.956593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194127e0-bc8d-458d-aaf9-0154b90f09ad None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:48.962533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:48.963788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:48.964217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:48.964641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] PATH_INFO: `/v3/projects/9b4ac880ab4e4a46993bf9f32153e76b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:48.971611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4ac880ab4e4a46993bf9f32153e76b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:48.974290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.083220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4ac880ab4e4a46993bf9f32153e76b', 'request_id': 'req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.091816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4ac880ab4e4a46993bf9f32153e76b', 'request_id': 'req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.105348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4ac880ab4e4a46993bf9f32153e76b', 'request_id': 'req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.144527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] The token cache is being invalidate because project 9b4ac880ab4e4a46993bf9f32153e76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:49.144912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.146828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6efe1fb7-f2bd-4a66-a89e-81f920a41fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.150493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 875/1777] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:48 2022] DELETE /identity/v3/projects/9b4ac880ab4e4a46993bf9f32153e76b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:49.156237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.157880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.158383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.193892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:49.196260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.303251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:49.335373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 903/1778] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:49.335618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069153e-7673-44c7-8949-089b182d5456 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.335981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069153e-7673-44c7-8949-089b182d5456 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.336276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069153e-7673-44c7-8949-089b182d5456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.358823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6069153e-7673-44c7-8949-089b182d5456 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:49.360954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6069153e-7673-44c7-8949-089b182d5456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.376626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 876/1779] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:49.378345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.389218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6b58-ea9b-41b8-bfb8-11348b4d1610 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.398836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.399981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.399981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.400249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.401167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:49.401579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.405176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.430437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 904/1780] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:49.434784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069153e-7673-44c7-8949-089b182d5456 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.447907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069153e-7673-44c7-8949-089b182d5456 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.460091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.461421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.462624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.463116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.465653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.469058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.531561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 877/1781] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:49.535335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.549225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3b288-63dd-4266-8a83-8bde1183b73b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.678601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.679506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.679949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.680633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.682653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.684898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.698397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.700403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.719482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 905/1782] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:49.725801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.739403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da9fd5-31f9-4b57-8873-bae6ebb5ee9f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.753173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.754060 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf682d-9cd0-42a3-98ec-dc4261a30566 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.754237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.755025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.755025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] PATH_INFO: `/v3/projects/e3596627a71e494dadc229f62267dd1c` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.756164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3596627a71e494dadc229f62267dd1c)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.760404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.768835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.770352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.771311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.771685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.772502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.779205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.813425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 906/1783] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:49.814367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.829658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f38bfd-dd1b-4188-addd-5135a4a2c8d1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.838646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.839437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.840495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.840681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.842049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.843934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.867012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3596627a71e494dadc229f62267dd1c', 'request_id': 'req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.876313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3596627a71e494dadc229f62267dd1c', 'request_id': 'req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.886623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 907/1784] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:49.891177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.893906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3596627a71e494dadc229f62267dd1c', 'request_id': 'req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.903272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fa1d8-118b-4c89-ab69-d0a4ec6d5af6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.948352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] The token cache is being invalidate because project e3596627a71e494dadc229f62267dd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:49.948882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.949956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.956866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 878/1785] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:49 2022] DELETE /identity/v3/projects/e3596627a71e494dadc229f62267dd1c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:49.958605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.964340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:50.079747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:50.115782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668016f-e788-494f-82d5-e29290d386c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:50.116701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668016f-e788-494f-82d5-e29290d386c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:50.116999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668016f-e788-494f-82d5-e29290d386c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:50.117278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668016f-e788-494f-82d5-e29290d386c0 admin admin] PATH_INFO: `/v3/projects/646bc985ae7e4254af56378e6d11d78d/users/43f4a079875f4ce6801a31add5008368/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:50.172512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668016f-e788-494f-82d5-e29290d386c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646bc985ae7e4254af56378e6d11d78d, user_id=43f4a079875f4ce6801a31add5008368, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:50.179381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668016f-e788-494f-82d5-e29290d386c0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:50.197453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce9e28-d6b0-4236-9f3d-6dc47543f39b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:50.255374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 908/1786] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:49 2022] PUT /identity/v3/projects/646bc985ae7e4254af56378e6d11d78d/users/43f4a079875f4ce6801a31add5008368/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:50.258448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:50.260361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:50.261663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:50.262427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:50.262713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:50.262825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:50.262987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] PATH_INFO: `/v3/users/c4672995f3714ff59b7f2d384077ceaf` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:50.267966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4672995f3714ff59b7f2d384077ceaf)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:50.273664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:50.318957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] MFA Rules not processed for user `43f4a079875f4ce6801a31add5008368`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:50.323554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:50.422252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:50.476732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4672995f3714ff59b7f2d384077ceaf'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:50.515467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4672995f3714ff59b7f2d384077ceaf'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:50.548606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4672995f3714ff59b7f2d384077ceaf'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:50.553179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4672995f3714ff59b7f2d384077ceaf'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:50.581891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4672995f3714ff59b7f2d384077ceaf'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:50.609574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 879/1787] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:49 2022] DELETE /identity/v3/users/c4672995f3714ff59b7f2d384077ceaf => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:50.638566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 909/1788] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:50.643625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:50.646287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:50.914642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206095-9c80-4284-b4e5-8a2b90f2ad2d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:50.933772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:50.934177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:50.934464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:50.934743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:50.937714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:50.940228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:51.055711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:51.057690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:51.057935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 880/1789] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:50 2022] POST /identity/v3/projects => generated 369 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:51.229825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057114-8fcc-4a50-875f-0455acd44fb0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:51.357257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:51.360746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:51.361133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:51.361481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:51.362288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:51.370227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:51.412506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 910/1790] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:51 2022] POST /identity/v3/users => generated 291 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:51.416601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:51.435447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21ecc8-dc96-43ea-9ea2-9147feee7a2a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:51.446671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:51.447354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:51.450576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:51.451234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:51.452148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:51.459930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:51.497199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 881/1791] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:51.498655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:51.516493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a478f68-70ae-49a0-b52a-a753810fcdcb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:51.538487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:51.540150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:51.541011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:51.541305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] PATH_INFO: `/v3/projects/9d839a349f1e4b699fd5a376be086ad4/users/20d470cdabca4a21bc96dd014f80e342/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:51.586481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d839a349f1e4b699fd5a376be086ad4, user_id=20d470cdabca4a21bc96dd014f80e342, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:51.595656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:51.625929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 911/1792] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:51 2022] PUT /identity/v3/projects/9d839a349f1e4b699fd5a376be086ad4/users/20d470cdabca4a21bc96dd014f80e342/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:51.630370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:51.645046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39fade-3480-422d-8663-c469f155203d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:51.721364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:51.818309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148d190-4d53-4dbc-928a-be8de69862f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:51.819538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148d190-4d53-4dbc-928a-be8de69862f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:51.820003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148d190-4d53-4dbc-928a-be8de69862f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:51.820378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148d190-4d53-4dbc-928a-be8de69862f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:51.821680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148d190-4d53-4dbc-928a-be8de69862f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:51.823911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148d190-4d53-4dbc-928a-be8de69862f1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:51.855525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 882/1793] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:51.856391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:51.882107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018c7ba-0cac-4907-87d8-070ff05bd3cb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:51.903503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:51.906714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:51.907807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:51.907807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] PATH_INFO: `/v3/projects/9d839a349f1e4b699fd5a376be086ad4/users/20d470cdabca4a21bc96dd014f80e342/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:51.914529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d839a349f1e4b699fd5a376be086ad4, user_id=20d470cdabca4a21bc96dd014f80e342, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:51.917468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:51.955313 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 912/1794] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:51 2022] PUT /identity/v3/projects/9d839a349f1e4b699fd5a376be086ad4/users/20d470cdabca4a21bc96dd014f80e342/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:51.974905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee08d62-5f9a-4ecf-9e3f-0b6b5b1e4aa4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:51.975719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee08d62-5f9a-4ecf-9e3f-0b6b5b1e4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:51.992207 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:51.995197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee08d62-5f9a-4ecf-9e3f-0b6b5b1e4aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:51.995945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:52.080807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:52.109211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6ee08d62-5f9a-4ecf-9e3f-0b6b5b1e4aa4 None None] MFA Rules not processed for user `20d470cdabca4a21bc96dd014f80e342`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:52.111591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6ee08d62-5f9a-4ecf-9e3f-0b6b5b1e4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:52.211684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649adb5-7a6f-402b-8162-3df222b6c4bc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:52.237002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:52.238687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:52.239800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:52.240333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] PATH_INFO: `/v3/projects/1d3f4cb22e2f4952a2ddeda5eb07cd76` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:52.244409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3f4cb22e2f4952a2ddeda5eb07cd76)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:52.261084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:52.318275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 883/1795] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:52.319534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538174-c243-45d2-a5cf-0d889bc9c607 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:52.319958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538174-c243-45d2-a5cf-0d889bc9c607 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:52.319958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538174-c243-45d2-a5cf-0d889bc9c607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:52.397261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-09538174-c243-45d2-a5cf-0d889bc9c607 None None] MFA Rules not processed for user `a3792881ae73408db651dd6eb09b3d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:52.401900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-09538174-c243-45d2-a5cf-0d889bc9c607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:52.446159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3f4cb22e2f4952a2ddeda5eb07cd76', 'request_id': 'req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:52.471305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3f4cb22e2f4952a2ddeda5eb07cd76', 'request_id': 'req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:52.495312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3f4cb22e2f4952a2ddeda5eb07cd76', 'request_id': 'req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:52.541529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] The token cache is being invalidate because project 1d3f4cb22e2f4952a2ddeda5eb07cd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:52.542892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:52.564569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:52.581102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 913/1796] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:51 2022] DELETE /identity/v3/projects/1d3f4cb22e2f4952a2ddeda5eb07cd76 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:54:52.586816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:52.590423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:52.682974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 884/1797] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:52.685764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893026-0722-4717-8968-5801d0f35b57 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:52.686060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893026-0722-4717-8968-5801d0f35b57 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:52.686410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed893026-0722-4717-8968-5801d0f35b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:52.753088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ed893026-0722-4717-8968-5801d0f35b57 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:52.755719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ed893026-0722-4717-8968-5801d0f35b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:52.839972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5af5a0-d6a4-4c3e-a3a9-c04114c31335 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:52.857939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:52.860070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:52.862306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:52.863694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:52.869518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:52.968780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:53.026881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 885/1798] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:53.037367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.037665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.037951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.074783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:53.077907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:53.098992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.100477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.110377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 886/1799] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:53.112493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.126162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dec39a-621d-4313-bdcb-54a3a51fc172 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.128777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:53.140170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.140865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.141178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.141456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.142923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 914/1800] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:53.153895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:53.154226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.156092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.216340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 887/1801] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:53.218198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.245264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330b0ae-f6b7-4816-ae38-d6e29260ef2a service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.257624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.261968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.265908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.266672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.267455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.279430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.328851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 915/1802] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:53 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:53.334144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.360399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da6f8-997c-4134-b6b0-4e5372119f10 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.562868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.563752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.564133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.567025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.569938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.575524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.641277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.651295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 888/1803] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:53 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:53.659611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706688d-0a4a-4401-8e62-43e461f62b6b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.677852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.678553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.679967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.680257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.683063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.685998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.686248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.688863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:53.715648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 916/1804] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:53.716996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.719641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350fcad-e5af-48c7-80e1-383669fb44a4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.736256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.737478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.738055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.738539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] PATH_INFO: `/v3/users/897ea6bf46a74c70b2f8bd40573d691f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.740733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897ea6bf46a74c70b2f8bd40573d691f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.746341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.754451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1776-c6b5-48ad-aae9-8bef34e1b85d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.774669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.775392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.775676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.775950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.777905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.779924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.796982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 917/1805] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:53.798763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:53.820186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bd349-2869-4369-a13b-0d362fe9ebbc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:53.846640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68b7d-ffc2-4e9f-984b-6ced7b6f7c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:53.850848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68b7d-ffc2-4e9f-984b-6ced7b6f7c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.851202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68b7d-ffc2-4e9f-984b-6ced7b6f7c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.851522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68b7d-ffc2-4e9f-984b-6ced7b6f7c2f admin admin] PATH_INFO: `/v3/projects/f9d09549bdc84db790eb3d54bcc53798/users/254a60d959984a1789369eefdfcca9cf/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.881512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897ea6bf46a74c70b2f8bd40573d691f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:53.901562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897ea6bf46a74c70b2f8bd40573d691f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:53.909589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e68b7d-ffc2-4e9f-984b-6ced7b6f7c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d09549bdc84db790eb3d54bcc53798, user_id=254a60d959984a1789369eefdfcca9cf, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:53.911729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897ea6bf46a74c70b2f8bd40573d691f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:53.912658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897ea6bf46a74c70b2f8bd40573d691f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:53.921030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e68b7d-ffc2-4e9f-984b-6ced7b6f7c2f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:53.925161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cabf148b-d336-4f1e-903d-34fdb32fca02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897ea6bf46a74c70b2f8bd40573d691f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:53.937444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 889/1806] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:53 2022] DELETE /identity/v3/users/897ea6bf46a74c70b2f8bd40573d691f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:53.952199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.952596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.953059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.966168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 918/1807] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:53 2022] PUT /identity/v3/projects/f9d09549bdc84db790eb3d54bcc53798/users/254a60d959984a1789369eefdfcca9cf/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:53.981370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:53.983144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:53.983449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:53.994615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:53.996065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.048146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:54.077772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] MFA Rules not processed for user `254a60d959984a1789369eefdfcca9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:54.079044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.182060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 890/1808] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:54.252183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:54.255107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.285283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 919/1809] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:54.295891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:54.313262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.359263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca77d55-dc3c-4182-826a-a0789da65ec4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:54.370451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:54.371448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.372786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.373551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.375137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:54.377421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:54.445541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 920/1810] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:54.445743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9915d53-2fe3-445a-bf6a-3622fcf0d985 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:54.447663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:54.614647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e7544-6438-4c77-81a2-f0e3a5256854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:54.621477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e7544-6438-4c77-81a2-f0e3a5256854 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.621775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e7544-6438-4c77-81a2-f0e3a5256854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.624746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e7544-6438-4c77-81a2-f0e3a5256854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.646958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37b040-fc33-4b88-bb15-118e8bde833d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:54.655746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e7544-6438-4c77-81a2-f0e3a5256854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:54.657463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e7544-6438-4c77-81a2-f0e3a5256854 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:54.677751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b0d01-9906-4f29-9869-3a2c86b0d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:54.679726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b0d01-9906-4f29-9869-3a2c86b0d7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.680123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b0d01-9906-4f29-9869-3a2c86b0d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.681699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b0d01-9906-4f29-9869-3a2c86b0d7e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.684228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b0d01-9906-4f29-9869-3a2c86b0d7e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:54.687259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 891/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:54.690452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b0d01-9906-4f29-9869-3a2c86b0d7e8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:54.724198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:54.735099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe793c-8743-48b4-aa2f-6a851052123d None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.735099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe793c-8743-48b4-aa2f-6a851052123d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.735283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe793c-8743-48b4-aa2f-6a851052123d None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.736862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 892/1812] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:54.774015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe793c-8743-48b4-aa2f-6a851052123d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:54.774249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 921/1813] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:54 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:54.793867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.796312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.796846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.807775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe793c-8743-48b4-aa2f-6a851052123d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:54.828301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:54.831963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.832359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.832837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.833713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:54.835466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:54.841462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:54.843833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.875919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 893/1814] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:54.883105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:54.920991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480d6dc-aafe-436c-9eeb-9491fcc51372 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:54.935764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:54.937026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.937026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.937251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] PATH_INFO: `/v3/projects/71d53930114642dbbeaf29d1b3a652bf/users/6475e0951656476ea80dd6060f401bda/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.992187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 922/1815] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:54.996043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d53930114642dbbeaf29d1b3a652bf, user_id=6475e0951656476ea80dd6060f401bda, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:54.999871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:55.043834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 894/1816] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:54 2022] PUT /identity/v3/projects/71d53930114642dbbeaf29d1b3a652bf/users/6475e0951656476ea80dd6060f401bda/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:55.047969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:55.061247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd1745-9035-4468-83ac-7e51054b68d7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:55.168648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c5ebc-1c14-400d-847f-ee461eeb00b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:55.169268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5ebc-1c14-400d-847f-ee461eeb00b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:55.169557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5ebc-1c14-400d-847f-ee461eeb00b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:55.169983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5ebc-1c14-400d-847f-ee461eeb00b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:55.170738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c5ebc-1c14-400d-847f-ee461eeb00b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:55.172882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c5ebc-1c14-400d-847f-ee461eeb00b1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:55.190509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 923/1817] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:55.195248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:55.206615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7b8ca-f3d7-44b0-ba2c-790dd3292994 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:55.211785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:55.212654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:55.212971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:55.213366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] PATH_INFO: `/v3/projects/71d53930114642dbbeaf29d1b3a652bf/users/6475e0951656476ea80dd6060f401bda/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:55.215439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d53930114642dbbeaf29d1b3a652bf, user_id=6475e0951656476ea80dd6060f401bda, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:55.218269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:55.242849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 895/1818] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:55 2022] PUT /identity/v3/projects/71d53930114642dbbeaf29d1b3a652bf/users/6475e0951656476ea80dd6060f401bda/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:55.245645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:55.246119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:55.246546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:55.328444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] MFA Rules not processed for user `6475e0951656476ea80dd6060f401bda`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:55.330882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:55.499255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:55.501240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:55.524072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 924/1819] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:55.547611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:55.555157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:55.565753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:55.643039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:55.751603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42944927-ad3d-483d-a8b6-71e18736d042 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:55.767021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:55.767713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:55.768185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:55.768377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38af8ae-46a3-4468-b402-5bf9da9ea830 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:55.768461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:55.782406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:55.783191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:55.783483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:55.783762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:55.792047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:55.795094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:55.835491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 896/1820] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:55.904688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:55.908889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:55.915808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:55.917402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:55.960973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 925/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:56.135582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d877-38c0-42de-aa4b-929fdbbea578 service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:56.142600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:56.143667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:56.145329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:56.145629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] PATH_INFO: `/v3/projects/f1bc1a49abeb4fe3957daa284884b32b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:56.151677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bc1a49abeb4fe3957daa284884b32b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:56.151677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:56.242757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bc1a49abeb4fe3957daa284884b32b', 'request_id': 'req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.253765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bc1a49abeb4fe3957daa284884b32b', 'request_id': 'req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.271896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bc1a49abeb4fe3957daa284884b32b', 'request_id': 'req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.295270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] The token cache is being invalidate because project f1bc1a49abeb4fe3957daa284884b32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:56.295574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.300744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.305360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 897/1822] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:55 2022] DELETE /identity/v3/projects/f1bc1a49abeb4fe3957daa284884b32b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:56.309611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:56.325095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f999ef-25b6-44d4-a55b-f83c8923c446 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:56.431451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:56.434058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:56.434377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:56.434661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] PATH_INFO: `/v3/users/ea88e5a638ef4b98ba17c21de6189473` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:56.439626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea88e5a638ef4b98ba17c21de6189473)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:56.445011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:56.522797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:56.525264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:56.552624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c1a0e-c704-46c3-97ae-c3872ffd70a7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:56.565202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:56.567792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:56.568068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:56.568450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] PATH_INFO: `/v3/users/43f4a079875f4ce6801a31add5008368` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:56.569785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f4a079875f4ce6801a31add5008368)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:56.574092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:56.587843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea88e5a638ef4b98ba17c21de6189473'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.612536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:56.627725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea88e5a638ef4b98ba17c21de6189473'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.643603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea88e5a638ef4b98ba17c21de6189473'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.644358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea88e5a638ef4b98ba17c21de6189473'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.659067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b3b4b46-863d-4f13-803f-ebf22c0bd6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea88e5a638ef4b98ba17c21de6189473'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.674847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 926/1823] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:56 2022] DELETE /identity/v3/users/ea88e5a638ef4b98ba17c21de6189473 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:56.692749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f4a079875f4ce6801a31add5008368'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.698822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:56.731841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f4a079875f4ce6801a31add5008368'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.755604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f4a079875f4ce6801a31add5008368'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.757476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f4a079875f4ce6801a31add5008368'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.774528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f4a079875f4ce6801a31add5008368'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:56.790320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 898/1824] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:56 2022] DELETE /identity/v3/users/43f4a079875f4ce6801a31add5008368 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:56.795803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:56.796087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:56.796369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:56.830065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:56.833151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:56.930043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 927/1825] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:56.945327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:56.947481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:57.032502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a8f0f-dd38-4cfa-b36f-75dfcc0d8eb0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:57.037710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb947e5-9374-47fd-9fc6-9256d16a9e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:57.038957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb947e5-9374-47fd-9fc6-9256d16a9e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:57.038957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb947e5-9374-47fd-9fc6-9256d16a9e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:57.039358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb947e5-9374-47fd-9fc6-9256d16a9e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:57.067388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb947e5-9374-47fd-9fc6-9256d16a9e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:57.069513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb947e5-9374-47fd-9fc6-9256d16a9e74 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:57.087204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 899/1826] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:57.260356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:57.261766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:57.278440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f358371-4956-4f43-b71d-932c5c89a770 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:57.286466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:57.287474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:57.287811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:57.288505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] PATH_INFO: `/v3/projects/95073951e05b4f0f82bfdafbe492268f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:57.289809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95073951e05b4f0f82bfdafbe492268f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:57.292589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:57.396152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95073951e05b4f0f82bfdafbe492268f', 'request_id': 'req-a41010c5-f244-42ca-bfd0-97aa82f261c9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:57.405327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95073951e05b4f0f82bfdafbe492268f', 'request_id': 'req-a41010c5-f244-42ca-bfd0-97aa82f261c9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:57.418081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95073951e05b4f0f82bfdafbe492268f', 'request_id': 'req-a41010c5-f244-42ca-bfd0-97aa82f261c9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:57.443645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] The token cache is being invalidate because project 95073951e05b4f0f82bfdafbe492268f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:57.444699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:57.446213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a41010c5-f244-42ca-bfd0-97aa82f261c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:57.452699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 928/1827] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:57 2022] DELETE /identity/v3/projects/95073951e05b4f0f82bfdafbe492268f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:57.455171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:57.456059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:57.457727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:57.487325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:57.489092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:57.627252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 900/1828] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:57.636816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:57.637315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:57.637608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:57.663958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:57.665369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:57.679109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 929/1829] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:57.680457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:57.695582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bc01d-493a-43f4-8654-cd736a6de914 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:57.701860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:57.703855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:57.704424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:57.704919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:57.706286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:57.707481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:57.709653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:57.725829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 901/1830] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:57.730333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:57.743509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e6874-366e-402b-bd72-4bbe16a41398 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:57.750684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:57.759887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:57.761335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:57.761335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:57.762241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:57.773377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:57.823993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 930/1831] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:57 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:57.828376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:57.843440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c0f7-f92f-42f4-ae0f-6f62d42ebbf7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.030996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.031676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.031963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.032241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.032960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.036966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.059946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:58.092405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 902/1832] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:57 2022] POST /identity/v3/users => generated 282 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:58.097621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:58.114829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2019c6-f9b6-4caf-8bea-eb728f003103 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.138219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.138911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.139195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.139475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.140208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.141858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.165709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 931/1833] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:58.169868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:58.185379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:58.188081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:58.189452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aeceff-2496-4d81-8d34-310ac5e7f58e admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.201919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.203474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.203907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.204321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.205446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.209990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.217277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70284ccd-0991-4ff0-ab17-5be379f8f807 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.230326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.231225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.231510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.231786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] PATH_INFO: `/v3/projects/646bc985ae7e4254af56378e6d11d78d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.235730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=646bc985ae7e4254af56378e6d11d78d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.238431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.242683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 903/1834] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:58.244316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:58.272067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba3b44-b07a-41f9-aeb8-53eabb372238 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.274689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:58.289448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c711e4a-7ab0-4049-abe7-84ac2170514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.290454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c711e4a-7ab0-4049-abe7-84ac2170514e admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.290740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c711e4a-7ab0-4049-abe7-84ac2170514e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.291741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c711e4a-7ab0-4049-abe7-84ac2170514e admin admin] PATH_INFO: `/v3/projects/1703b1ab46334940be4029b3705149f7/users/d842155eeec846ad9d639232ee53fdb7/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.324785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c711e4a-7ab0-4049-abe7-84ac2170514e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1703b1ab46334940be4029b3705149f7, user_id=d842155eeec846ad9d639232ee53fdb7, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.327526 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c711e4a-7ab0-4049-abe7-84ac2170514e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.344577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646bc985ae7e4254af56378e6d11d78d', 'request_id': 'req-0138834f-e877-454c-b2c4-93f22bd5e0fd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.364096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 904/1835] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:58 2022] PUT /identity/v3/projects/1703b1ab46334940be4029b3705149f7/users/d842155eeec846ad9d639232ee53fdb7/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:58.375489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646bc985ae7e4254af56378e6d11d78d', 'request_id': 'req-0138834f-e877-454c-b2c4-93f22bd5e0fd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.375791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.376091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.376371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.391601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646bc985ae7e4254af56378e6d11d78d', 'request_id': 'req-0138834f-e877-454c-b2c4-93f22bd5e0fd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.427227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] The token cache is being invalidate because project 646bc985ae7e4254af56378e6d11d78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:58.427521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.430279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.432726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 932/1836] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:58 2022] DELETE /identity/v3/projects/646bc985ae7e4254af56378e6d11d78d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:58.437139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:58.439914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:58.441617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] MFA Rules not processed for user `d842155eeec846ad9d639232ee53fdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:58.443016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:58.636519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 905/1837] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:58.647717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:58.649621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:58.691490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138834f-e877-454c-b2c4-93f22bd5e0fd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.788185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.789503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.790316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.790871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] PATH_INFO: `/v3/users/20d470cdabca4a21bc96dd014f80e342` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.793075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d470cdabca4a21bc96dd014f80e342)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.796006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.887373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35867-8171-4900-b695-ed83aa563f58 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:58.906010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:58.911001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:58.912745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:58.914134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:58.915401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:58.919856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:58.923307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d470cdabca4a21bc96dd014f80e342'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.932892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:58.961034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d470cdabca4a21bc96dd014f80e342'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.979009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d470cdabca4a21bc96dd014f80e342'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:58.979960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d470cdabca4a21bc96dd014f80e342'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:59.004252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9e10dbbe-995f-4706-8bbd-6925a421d3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d470cdabca4a21bc96dd014f80e342'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:59.009758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 906/1838] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:58 2022] POST /identity/v3/projects => generated 363 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:59.013089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:59.016770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:59.023282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 933/1839] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:58 2022] DELETE /identity/v3/users/20d470cdabca4a21bc96dd014f80e342 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:59.061046 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef11d5-a436-4c82-ad07-c1bb24120778 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.061715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef11d5-a436-4c82-ad07-c1bb24120778 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.062192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef11d5-a436-4c82-ad07-c1bb24120778 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.064479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 934/1840] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:54:59.127670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:59.176751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.177284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.177432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.205254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f96ec5-cfc5-4458-8244-1217e481745d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:59.217598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:59.218991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:59.352765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:59.353625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.354053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.354418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.355175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:59.358103 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:59.393143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 907/1841] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:59 2022] POST /identity/v3/users => generated 288 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:59.405185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:59.439717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693299f-d38f-4c60-adcc-408d12764d0a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:59.455240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:59.456833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 935/1842] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:59.458279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.458848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.459278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.461353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:59.463695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:59.484298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 908/1843] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:59.485688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:59.507138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c98dc-f435-4820-9470-8f7a604c0f24 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:59.512924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:59.514298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.515102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.515861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] PATH_INFO: `/v3/projects/dcd4f49c76da4ed894d18589af5739f6/users/a8c4fefcf9764232bcfc10768a3cc3f7/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.540469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd4f49c76da4ed894d18589af5739f6, user_id=a8c4fefcf9764232bcfc10768a3cc3f7, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:59.544106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:59.577297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 936/1844] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:59 2022] PUT /identity/v3/projects/dcd4f49c76da4ed894d18589af5739f6/users/a8c4fefcf9764232bcfc10768a3cc3f7/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:59.580704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:59.598244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078e31-e58d-417c-b0f1-15f10fa34a70 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:59.603023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:59.604886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:59.697349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:59.698054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.698344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.698624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.699629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:59.701658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:59.717139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 909/1845] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:59.721393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:59.738730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493623a9-5e0b-4b4e-b83f-82c212c91932 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:59.747058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f021d-2a0d-450b-abd0-9bd1d5302e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:59.747972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f021d-2a0d-450b-abd0-9bd1d5302e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.748257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f021d-2a0d-450b-abd0-9bd1d5302e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.748910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f021d-2a0d-450b-abd0-9bd1d5302e66 admin admin] PATH_INFO: `/v3/projects/dcd4f49c76da4ed894d18589af5739f6/users/a8c4fefcf9764232bcfc10768a3cc3f7/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.751347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f021d-2a0d-450b-abd0-9bd1d5302e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd4f49c76da4ed894d18589af5739f6, user_id=a8c4fefcf9764232bcfc10768a3cc3f7, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:59.755465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f021d-2a0d-450b-abd0-9bd1d5302e66 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:59.788914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675577-11cd-4e45-a30e-2c7c33670198 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:59.791671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 910/1846] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:59 2022] PUT /identity/v3/projects/dcd4f49c76da4ed894d18589af5739f6/users/a8c4fefcf9764232bcfc10768a3cc3f7/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:59.806072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.808392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.808976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.854979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:59.856146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] MFA Rules not processed for user `a8c4fefcf9764232bcfc10768a3cc3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:59.857567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:59.904825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:59.906475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:59.906946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:59.907571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:59.916425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:59.923187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:59.927843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:59.957210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 937/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:59.990321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 911/1848] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:00.001612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:00.003040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:00.107648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246627e7-20eb-471f-9ebc-112a52ea79fd service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:00.114219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:00.115706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:00.116244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:00.116839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:00.131285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:00.133780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:00.151298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 938/1849] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:00 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:00.483986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:00.494421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc5d3-fea7-40ea-ab4a-ac3e62613d44 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:00.513247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:00.513929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:00.514210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:00.514482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:00.518013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:00.618097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:00.619631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115691a-ae3c-4869-81b5-12cbd641c3e9 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:00.633288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 912/1850] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:00.779434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:00.781188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:00.905833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73343b68-73e4-4fa2-9ca8-c45d4f25ca8d service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:00.911426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:00.912515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:00.912868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:00.913268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] PATH_INFO: `/v3/projects/9d839a349f1e4b699fd5a376be086ad4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:00.914683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d839a349f1e4b699fd5a376be086ad4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:00.916782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:00.983345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d839a349f1e4b699fd5a376be086ad4', 'request_id': 'req-db090917-d158-4106-bd98-56988b6fd0f9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:00.989726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d839a349f1e4b699fd5a376be086ad4', 'request_id': 'req-db090917-d158-4106-bd98-56988b6fd0f9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:00.999180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d839a349f1e4b699fd5a376be086ad4', 'request_id': 'req-db090917-d158-4106-bd98-56988b6fd0f9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:01.003761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:01.021281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] The token cache is being invalidate because project 9d839a349f1e4b699fd5a376be086ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:01.021653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:01.022374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-db090917-d158-4106-bd98-56988b6fd0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:01.023983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 939/1851] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:00 2022] DELETE /identity/v3/projects/9d839a349f1e4b699fd5a376be086ad4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:01.029032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.029486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.029597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.048609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:01.049861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:01.109257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 913/1852] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:01.117934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.118229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.118541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.136455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:01.137687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:01.145722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 940/1853] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:01.149767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.160151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc65c0-f1b5-4c5d-91d9-16bb3eb2fa3a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.164915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.165597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.165882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.166163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.166885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:01.167193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.168795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.181053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 914/1854] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:01.185041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.194226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdb149-0e07-4b11-9404-b18de0e83207 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.198841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.199493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.199777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.200056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.200740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.202697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.228196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 941/1855] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:01.232042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.242562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc7a74-cced-43ed-817f-5cc3e2ea60e2 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.286221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:01.297815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.298487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.298776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.299057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.299749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.302302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.324190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 915/1856] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:01.325647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.336226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032725bc-dc8b-45ca-b5f0-fff2f880da38 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.341009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.341677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.341963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.342481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.343034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.344653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.355615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 942/1857] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:01.359297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.369668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed7ba0-0cb5-4f97-8246-fdf818bd3f79 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.374468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde9698-2513-48b2-ac47-a2b8c65e615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.375125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde9698-2513-48b2-ac47-a2b8c65e615a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.375406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde9698-2513-48b2-ac47-a2b8c65e615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.375675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde9698-2513-48b2-ac47-a2b8c65e615a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.376384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde9698-2513-48b2-ac47-a2b8c65e615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.378125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde9698-2513-48b2-ac47-a2b8c65e615a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.389285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 916/1858] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:01.393506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.404261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bbb6c-ea49-450e-b198-3cef8ea9df3d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.408749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.410345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.410621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.410909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] PATH_INFO: `/v3/projects/7588ba1f6eae4f14b15f647aaff28a31/users/0b4e950180394246ab5aae29549b922c/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.425784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7588ba1f6eae4f14b15f647aaff28a31, user_id=0b4e950180394246ab5aae29549b922c, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.428440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.442691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 943/1859] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:01 2022] PUT /identity/v3/projects/7588ba1f6eae4f14b15f647aaff28a31/users/0b4e950180394246ab5aae29549b922c/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:01.453006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.453386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.453665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.494027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] MFA Rules not processed for user `0b4e950180394246ab5aae29549b922c`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:01.495625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:01.575120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 917/1860] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:01.579599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.642448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed6ea9-10bb-42f5-806a-47daae478d6e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.648041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.648715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.649031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.649320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.650016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.652345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.688201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 944/1861] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:01.691848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.703590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce6bda-3697-4f75-aa10-153902cbaed1 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.765121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.765992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.766276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.766552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.767248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.769799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.798333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 918/1862] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:01 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:01.799538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.810716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a65a78-dd80-4f53-8b36-8aff2166e833 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.815357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.817179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.817470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.817756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.818483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.820077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.830495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 945/1863] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:01.835198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.845026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e7299-fab0-46b7-9ecc-7ab98f80cfa5 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.850391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.851275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.851558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.851890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] PATH_INFO: `/v3/projects/1504888db8e54a3ebeb5b769cae6ac30/users/7c0e7ef2e30e4a56ab0c2b6abab41ae5/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.868897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1504888db8e54a3ebeb5b769cae6ac30, user_id=7c0e7ef2e30e4a56ab0c2b6abab41ae5, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.871598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.885696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 919/1864] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:01 2022] PUT /identity/v3/projects/1504888db8e54a3ebeb5b769cae6ac30/users/7c0e7ef2e30e4a56ab0c2b6abab41ae5/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:01.889618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.900238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d104c-183c-444d-bed1-bbcd2f7ecba3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.959082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e08be-48fc-4d76-b4a5-2fbbfda3e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.959745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e08be-48fc-4d76-b4a5-2fbbfda3e18c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.960027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e08be-48fc-4d76-b4a5-2fbbfda3e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.960300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e08be-48fc-4d76-b4a5-2fbbfda3e18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.961059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e08be-48fc-4d76-b4a5-2fbbfda3e18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:01.962639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e08be-48fc-4d76-b4a5-2fbbfda3e18c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:01.974681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:01.974978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 946/1865] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:01.978768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:01.989839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fe799-e029-4825-9b52-71388817b537 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:01.994539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:01.995557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:01.995837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:01.996111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] PATH_INFO: `/v3/projects/1504888db8e54a3ebeb5b769cae6ac30/users/7c0e7ef2e30e4a56ab0c2b6abab41ae5/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:01.998238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1504888db8e54a3ebeb5b769cae6ac30, user_id=7c0e7ef2e30e4a56ab0c2b6abab41ae5, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:02.000970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:02.015667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 920/1866] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:01 2022] PUT /identity/v3/projects/1504888db8e54a3ebeb5b769cae6ac30/users/7c0e7ef2e30e4a56ab0c2b6abab41ae5/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:02.030007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:02.030007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:02.030007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:02.057180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] MFA Rules not processed for user `7c0e7ef2e30e4a56ab0c2b6abab41ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:02.058325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:02.130529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 947/1867] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:02.141523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:02.143241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:02.154552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:02.202012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b0330-f936-4f1b-b877-06130e5dd9e8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:02.205733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4241d-f151-4474-8ec2-4557e6cd171e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:02.207243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4241d-f151-4474-8ec2-4557e6cd171e service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:02.207490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4241d-f151-4474-8ec2-4557e6cd171e service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:02.207773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4241d-f151-4474-8ec2-4557e6cd171e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:02.218076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4241d-f151-4474-8ec2-4557e6cd171e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:02.220500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4241d-f151-4474-8ec2-4557e6cd171e service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:02.231633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 921/1868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:02.309824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:02.392193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb2dbc-0037-43e4-b688-0a056165bc4e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:02.397833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:02.398756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:02.399039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:02.399310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] PATH_INFO: `/v3/users/0b4e950180394246ab5aae29549b922c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:02.400536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4e950180394246ab5aae29549b922c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:02.402818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:02.468228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4e950180394246ab5aae29549b922c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:02.485866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4e950180394246ab5aae29549b922c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:02.496659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4e950180394246ab5aae29549b922c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:02.497614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4e950180394246ab5aae29549b922c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:02.508587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4e950180394246ab5aae29549b922c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:02.516749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 948/1869] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:02 2022] DELETE /identity/v3/users/0b4e950180394246ab5aae29549b922c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:02.522091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:02.522401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:02.522658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:02.548120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:02.549487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:02.637209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 922/1870] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:02.656716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:02.659040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:02.666776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:02.729222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ee23f-5a11-4bee-8b0b-cffe4b1ac3fc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:02.733240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:02.733913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:02.734197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:02.734473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:02.748761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:02.750275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:02.770097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 949/1871] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:03.198239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:03.199953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:03.286818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a83be-5859-48ac-b8d3-d1fa08146459 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:03.290677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:03.291334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:03.291824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:03.292340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:03.294568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:03.426363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:03.428835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:03.442330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 923/1872] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:03.601259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:03.603759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:03.645980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af4ff4-da25-4d69-b467-9b49532efc44 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:03.651687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:03.652996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:03.653353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:03.653701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] PATH_INFO: `/v3/projects/7588ba1f6eae4f14b15f647aaff28a31` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:03.654994 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7588ba1f6eae4f14b15f647aaff28a31)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:03.657022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:03.759598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7588ba1f6eae4f14b15f647aaff28a31', 'request_id': 'req-4f9bb820-f669-40a4-871d-c857a09872fc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:03.775822 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7588ba1f6eae4f14b15f647aaff28a31', 'request_id': 'req-4f9bb820-f669-40a4-871d-c857a09872fc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:03.783376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7588ba1f6eae4f14b15f647aaff28a31', 'request_id': 'req-4f9bb820-f669-40a4-871d-c857a09872fc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:03.802656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] The token cache is being invalidate because project 7588ba1f6eae4f14b15f647aaff28a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:03.802763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:03.803769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:03.808364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 950/1873] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:03 2022] DELETE /identity/v3/projects/7588ba1f6eae4f14b15f647aaff28a31 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:03.809593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:03.815771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:03.823335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd4635-a784-4dbc-bdf3-33779760bbbc service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:03.903629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:03.904776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:03.905319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:03.905832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] PATH_INFO: `/v3/users/7c0e7ef2e30e4a56ab0c2b6abab41ae5` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:03.907700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0e7ef2e30e4a56ab0c2b6abab41ae5)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:03.910276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:03.989502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0e7ef2e30e4a56ab0c2b6abab41ae5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.001606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0e7ef2e30e4a56ab0c2b6abab41ae5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.009401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0e7ef2e30e4a56ab0c2b6abab41ae5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.010128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0e7ef2e30e4a56ab0c2b6abab41ae5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.018688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3a1b300d-b79a-46ff-a04a-8ade560d12c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0e7ef2e30e4a56ab0c2b6abab41ae5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.028167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 924/1874] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:03 2022] DELETE /identity/v3/users/7c0e7ef2e30e4a56ab0c2b6abab41ae5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:04.381738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.382910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:04.396175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bb820-f669-40a4-871d-c857a09872fc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.459595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.460469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.460756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.461076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] PATH_INFO: `/v3/projects/1504888db8e54a3ebeb5b769cae6ac30` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.462271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1504888db8e54a3ebeb5b769cae6ac30)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.464192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:04.503098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:04.517897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1504888db8e54a3ebeb5b769cae6ac30', 'request_id': 'req-7ba59336-9a77-498c-8ac2-211026524a0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.524485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1504888db8e54a3ebeb5b769cae6ac30', 'request_id': 'req-7ba59336-9a77-498c-8ac2-211026524a0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.531089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1504888db8e54a3ebeb5b769cae6ac30', 'request_id': 'req-7ba59336-9a77-498c-8ac2-211026524a0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.546382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] The token cache is being invalidate because project 1504888db8e54a3ebeb5b769cae6ac30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:04.546805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.547452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7ba59336-9a77-498c-8ac2-211026524a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:04.549366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 951/1875] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:04 2022] DELETE /identity/v3/projects/1504888db8e54a3ebeb5b769cae6ac30 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:04.554486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.554955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.555048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.576565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:04.577774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:04.638066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 925/1876] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:04.646928 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.647384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.647544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.670355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:04.671552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:04.680473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 952/1877] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:04.685213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.695413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8559a1-0944-4dcf-ad8a-e83785301aef None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.700085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.700748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.701057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.701334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.702049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:04.702353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.703949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:04.716531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 926/1878] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:04.720868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.730709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b147d5-76c2-4537-8c5b-b81b39fbeeef None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.735384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.736046 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.736331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.736608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.737389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.739307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:04.773534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 953/1879] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:04 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:04.778009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.789139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685c98-65d4-4e5d-b6fd-6ccf90dccf6a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.794230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:04.850366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.851040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.851329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.851609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.852290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.854249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:04.873638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 927/1880] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:04 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:04.878550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.888997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93632f2-b03e-4cb1-984e-f281c5067a31 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.894348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.895018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.895327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.895603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.896327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.898028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:04.908978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 954/1881] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:04.912773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.922663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7d9ac-5326-4bbf-99e7-35752d824643 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.927229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647452d-2c03-4dfc-8516-d4c394a83b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.927874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647452d-2c03-4dfc-8516-d4c394a83b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.928158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647452d-2c03-4dfc-8516-d4c394a83b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.928433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647452d-2c03-4dfc-8516-d4c394a83b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.929187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647452d-2c03-4dfc-8516-d4c394a83b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.930778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647452d-2c03-4dfc-8516-d4c394a83b3b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:04.941321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 928/1882] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:04.946002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:04.967861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48562259-ad81-4756-b43e-b8a51c967127 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:04.973502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:04.974949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:04.974949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:04.974949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] PATH_INFO: `/v3/projects/978b44dd2f2c43829574b70250f29e96/users/a21f75c957e34064bef2fe43412f6a90/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:04.989592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978b44dd2f2c43829574b70250f29e96, user_id=a21f75c957e34064bef2fe43412f6a90, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:04.992593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.007405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 955/1883] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:04 2022] PUT /identity/v3/projects/978b44dd2f2c43829574b70250f29e96/users/a21f75c957e34064bef2fe43412f6a90/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:05.019200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.019639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.020195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.049440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] MFA Rules not processed for user `a21f75c957e34064bef2fe43412f6a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:05.050916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:05.119964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 929/1884] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:05.124431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.190080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8554dfd-2e2d-48a9-a056-ee8de2f7ef97 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.195534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.196150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.196430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.196706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.197443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.199349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.228438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 956/1885] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:05 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:05.229904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.241875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd6f24-18c1-4b68-9608-b1131c71d858 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.299451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.300823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.301154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.301948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.302655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.304584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.328670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 930/1886] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:05 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:05.333280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.347393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8364f9-7c87-460f-b3c4-3083252ffd09 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.352158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.355047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.355047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.355047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.355047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.355753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.367942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 957/1887] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:05.372155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.383921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616cb44-c9ae-428b-8976-2e20530df7f7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.389101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.390027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.390313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.390596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] PATH_INFO: `/v3/projects/7ab5d79cdf764b809e73ccf4ccd29c1b/users/75925440fe7f404686ec27bd3060e84c/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.393002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:05.409966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab5d79cdf764b809e73ccf4ccd29c1b, user_id=75925440fe7f404686ec27bd3060e84c, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.412650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.434320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 931/1888] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:05 2022] PUT /identity/v3/projects/7ab5d79cdf764b809e73ccf4ccd29c1b/users/75925440fe7f404686ec27bd3060e84c/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:05.438904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.450223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c87f3-5d2d-4778-888c-09104447dae6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.482016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:05.513094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ec882-1e3a-42a9-8bbe-066f81b8275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.513871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec882-1e3a-42a9-8bbe-066f81b8275d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.514216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec882-1e3a-42a9-8bbe-066f81b8275d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.514556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ec882-1e3a-42a9-8bbe-066f81b8275d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.515349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ec882-1e3a-42a9-8bbe-066f81b8275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.517072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ec882-1e3a-42a9-8bbe-066f81b8275d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.527969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 958/1889] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:05.532039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.542796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d786b7-d377-4c5e-882c-8053656bccbc admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.547517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.548534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.548815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.549138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] PATH_INFO: `/v3/projects/7ab5d79cdf764b809e73ccf4ccd29c1b/users/75925440fe7f404686ec27bd3060e84c/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.551373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab5d79cdf764b809e73ccf4ccd29c1b, user_id=75925440fe7f404686ec27bd3060e84c, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.554120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.564707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 932/1890] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:05 2022] PUT /identity/v3/projects/7ab5d79cdf764b809e73ccf4ccd29c1b/users/75925440fe7f404686ec27bd3060e84c/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:05.575351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.575639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.575913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.606944 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] MFA Rules not processed for user `75925440fe7f404686ec27bd3060e84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:05.608311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:05.686773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 959/1891] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:05.697775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:05.699485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:05.758541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaef14-1213-4df1-8921-c53be3a2c2f7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:05.765110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852fd6d-404f-458b-8770-d1f497c8dc68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:05.765110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fd6d-404f-458b-8770-d1f497c8dc68 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:05.765110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fd6d-404f-458b-8770-d1f497c8dc68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:05.765110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852fd6d-404f-458b-8770-d1f497c8dc68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:05.776111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852fd6d-404f-458b-8770-d1f497c8dc68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:05.778020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852fd6d-404f-458b-8770-d1f497c8dc68 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:05.789626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 933/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:06.330244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:06.404524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf6d5-bfc4-4844-b52d-b72fa1c22716 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:06.410120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:06.411032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:06.411315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:06.411592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] PATH_INFO: `/v3/users/a21f75c957e34064bef2fe43412f6a90` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:06.412826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21f75c957e34064bef2fe43412f6a90)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:06.415143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:06.522680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21f75c957e34064bef2fe43412f6a90'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:06.529640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:06.547957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21f75c957e34064bef2fe43412f6a90'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:06.573734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21f75c957e34064bef2fe43412f6a90'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:06.574538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21f75c957e34064bef2fe43412f6a90'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:06.586225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21f75c957e34064bef2fe43412f6a90'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:06.595922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 960/1893] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:06 2022] DELETE /identity/v3/users/a21f75c957e34064bef2fe43412f6a90 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:06.603165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:06.603165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:06.603785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:06.648134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:06.649582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:06.865281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:06.866924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:06.883308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 934/1894] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:06.895773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:06.901311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:07.021530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5ebb0-3c18-4f18-a8ca-6f26024ab2e1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:07.029243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:07.030321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:07.030609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:07.030888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] PATH_INFO: `/v3/users/d842155eeec846ad9d639232ee53fdb7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:07.032179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d842155eeec846ad9d639232ee53fdb7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:07.034957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:07.068356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b211d8-caeb-4776-81b0-3f5a6ec941e3 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:07.074097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31f4f-d1fa-4e49-8d04-a808c81c3d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:07.074886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31f4f-d1fa-4e49-8d04-a808c81c3d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:07.075304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31f4f-d1fa-4e49-8d04-a808c81c3d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:07.075767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31f4f-d1fa-4e49-8d04-a808c81c3d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:07.090368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31f4f-d1fa-4e49-8d04-a808c81c3d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:07.092034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31f4f-d1fa-4e49-8d04-a808c81c3d04 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:07.108505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd842155eeec846ad9d639232ee53fdb7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.108828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 935/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:07.123723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd842155eeec846ad9d639232ee53fdb7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.132590 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd842155eeec846ad9d639232ee53fdb7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.133495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd842155eeec846ad9d639232ee53fdb7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.145310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd842155eeec846ad9d639232ee53fdb7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.153722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 961/1896] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:06 2022] DELETE /identity/v3/users/d842155eeec846ad9d639232ee53fdb7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:07.158343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:07.158715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:07.159096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:07.179875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:07.181437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:07.193372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:07.269489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 936/1897] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:07.285716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:07.287768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:07.352444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338c5d0-36fe-4945-8cbe-a91a28eb69c5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:07.356323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:07.357060 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:07.357479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:07.357824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:07.365920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:07.369950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:07.372283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:07.383379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 962/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:07.541977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:07.544431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:07.565159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14629f-7613-451b-a036-5a36ebaf3bfe None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:07.573728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:07.575093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:07.575444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:07.576168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] PATH_INFO: `/v3/projects/978b44dd2f2c43829574b70250f29e96` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:07.577971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978b44dd2f2c43829574b70250f29e96)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:07.581752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:07.635878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978b44dd2f2c43829574b70250f29e96', 'request_id': 'req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.641552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978b44dd2f2c43829574b70250f29e96', 'request_id': 'req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.649552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978b44dd2f2c43829574b70250f29e96', 'request_id': 'req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.661221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] The token cache is being invalidate because project 978b44dd2f2c43829574b70250f29e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:07.661517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.662151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.663920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 937/1899] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:07 2022] DELETE /identity/v3/projects/978b44dd2f2c43829574b70250f29e96 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:07.667643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:07.679480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5446f-9b17-4ccf-b7d5-e85153227d6e service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:07.752973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:07.755540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:07.756145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:07.756569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] PATH_INFO: `/v3/users/75925440fe7f404686ec27bd3060e84c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:07.758143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75925440fe7f404686ec27bd3060e84c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:07.760521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:07.828508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75925440fe7f404686ec27bd3060e84c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.857623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75925440fe7f404686ec27bd3060e84c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.866405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75925440fe7f404686ec27bd3060e84c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.867378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75925440fe7f404686ec27bd3060e84c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.877184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75925440fe7f404686ec27bd3060e84c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:07.886458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 963/1900] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:07 2022] DELETE /identity/v3/users/75925440fe7f404686ec27bd3060e84c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:07.999095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:08.000614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:08.014777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc7dd-54d3-42a3-9037-35bdc325a9e1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:08.118166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:08.119125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:08.119494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:08.119833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] PATH_INFO: `/v3/projects/1703b1ab46334940be4029b3705149f7` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:08.121126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1703b1ab46334940be4029b3705149f7)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:08.123112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:08.168270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:08.176515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1703b1ab46334940be4029b3705149f7', 'request_id': 'req-6d34129d-f89c-4358-8966-6abc54da62c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.183010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1703b1ab46334940be4029b3705149f7', 'request_id': 'req-6d34129d-f89c-4358-8966-6abc54da62c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.191708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1703b1ab46334940be4029b3705149f7', 'request_id': 'req-6d34129d-f89c-4358-8966-6abc54da62c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.203244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] The token cache is being invalidate because project 1703b1ab46334940be4029b3705149f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:08.203529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.204231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.206741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 938/1901] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:07 2022] DELETE /identity/v3/projects/1703b1ab46334940be4029b3705149f7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:08.211206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:08.212903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:08.227892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fa36-743e-47bf-9a79-2121f346ea51 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:08.230963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:08.232680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:08.304798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:08.305952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:08.306443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:08.306899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] PATH_INFO: `/v3/users/a8c4fefcf9764232bcfc10768a3cc3f7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:08.315273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c4fefcf9764232bcfc10768a3cc3f7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:08.318338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:08.356918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:08.357483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34129d-f89c-4358-8966-6abc54da62c4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:08.370786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:08.371721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:08.373664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:08.373949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] PATH_INFO: `/v3/projects/7ab5d79cdf764b809e73ccf4ccd29c1b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:08.377382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab5d79cdf764b809e73ccf4ccd29c1b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:08.380737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:08.453003 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c4fefcf9764232bcfc10768a3cc3f7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.494354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c4fefcf9764232bcfc10768a3cc3f7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.522140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c4fefcf9764232bcfc10768a3cc3f7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.523997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c4fefcf9764232bcfc10768a3cc3f7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.524703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab5d79cdf764b809e73ccf4ccd29c1b', 'request_id': 'req-b2da20cc-c973-41b3-9ddd-544f571558ef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.538656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8b3bef34-a0f1-497c-afa6-44812840fd9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c4fefcf9764232bcfc10768a3cc3f7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.543673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab5d79cdf764b809e73ccf4ccd29c1b', 'request_id': 'req-b2da20cc-c973-41b3-9ddd-544f571558ef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.551083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 964/1902] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:08 2022] DELETE /identity/v3/users/a8c4fefcf9764232bcfc10768a3cc3f7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:08.569931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab5d79cdf764b809e73ccf4ccd29c1b', 'request_id': 'req-b2da20cc-c973-41b3-9ddd-544f571558ef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.615996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] The token cache is being invalidate because project 7ab5d79cdf764b809e73ccf4ccd29c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:08.619104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.622418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b2da20cc-c973-41b3-9ddd-544f571558ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:08.627403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 939/1903] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:08 2022] DELETE /identity/v3/projects/7ab5d79cdf764b809e73ccf4ccd29c1b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:08.632294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:08.632667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:08.633082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:08.686086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:08.687448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:08.818124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 965/1904] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:08.826967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:08.827597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:08.827980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:08.871010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:08.872266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:08.899155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 940/1905] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:08.903857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:08.923252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93beb08-c4f2-47c1-a614-f17c697c8cea None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:08.936460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:08.937470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:08.937771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:08.938054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:08.938986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:08.939395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:08.944733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:08.983036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 966/1906] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:08.987453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:08.998055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0763bec-8376-4880-8745-3e16efec08d7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.004998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.005686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.005971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.006266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.007586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.008907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.045564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 941/1907] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:08 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:09.046826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.059927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ab38-3cdd-4e93-9ab8-6e625c19fbf0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.155761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.157038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.157442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.161092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.162027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.164147 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.188261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 967/1908] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:09 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:09.192809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.210143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4bdf-9340-404e-871e-35bfb6eedc36 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.216238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.217022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.217317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.217590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.218806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.220462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.235951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 942/1909] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:09.237954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.249359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a50416-7ce3-4fec-9c70-ea6de4f6abf0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.254600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45e98b-2afc-4747-9759-fd95189a9ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.255267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45e98b-2afc-4747-9759-fd95189a9ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.255789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45e98b-2afc-4747-9759-fd95189a9ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.256072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45e98b-2afc-4747-9759-fd95189a9ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.257200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45e98b-2afc-4747-9759-fd95189a9ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.258690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45e98b-2afc-4747-9759-fd95189a9ea7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.261660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:09.277345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 968/1910] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:09.281142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.295913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ad86c-4685-4764-a62b-40716fc3d510 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.302613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.303520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.303808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.304608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] PATH_INFO: `/v3/projects/5206200b32f84b2caa25da78837d5d3d/users/d9d84836d1424e2aa0e3b3b49a41d122/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.322320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5206200b32f84b2caa25da78837d5d3d, user_id=d9d84836d1424e2aa0e3b3b49a41d122, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.325535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.329234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:09.343038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 943/1911] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:09 2022] PUT /identity/v3/projects/5206200b32f84b2caa25da78837d5d3d/users/d9d84836d1424e2aa0e3b3b49a41d122/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:09.354353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.354646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.355011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.391426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] MFA Rules not processed for user `d9d84836d1424e2aa0e3b3b49a41d122`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:09.392655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:09.495836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 969/1912] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:09.504097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.506411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:09.575179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.576817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:09.582471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d61f5-e891-4267-b1b7-c7579f0f39df admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.588490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.598297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.600153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.600726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.615216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.617068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.634162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 944/1913] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:09.655722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:09.685391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddd0bc-9c6c-48f5-b93c-6d23e1ce31db None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.692351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.693550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.693989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.694554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] PATH_INFO: `/v3/projects/dcd4f49c76da4ed894d18589af5739f6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.696226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd4f49c76da4ed894d18589af5739f6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.698591 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:09.790469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d46f9-7e28-4778-8fec-58f788a1e067 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:09.804119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd4f49c76da4ed894d18589af5739f6', 'request_id': 'req-f37c23a6-6006-4da1-b084-8064042aaba4'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:09.814907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd4f49c76da4ed894d18589af5739f6', 'request_id': 'req-f37c23a6-6006-4da1-b084-8064042aaba4'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:09.824761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd4f49c76da4ed894d18589af5739f6', 'request_id': 'req-f37c23a6-6006-4da1-b084-8064042aaba4'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:09.845305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] The token cache is being invalidate because project dcd4f49c76da4ed894d18589af5739f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:09.845612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:09.846776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f37c23a6-6006-4da1-b084-8064042aaba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:09.852637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 970/1914] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:09 2022] DELETE /identity/v3/projects/dcd4f49c76da4ed894d18589af5739f6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:09.856175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.856763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.859230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.929458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:09.930691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:09.953274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:09.960282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:09.961221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:09.961484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:09.961759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] PATH_INFO: `/v3/users/d9d84836d1424e2aa0e3b3b49a41d122` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:09.963192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d84836d1424e2aa0e3b3b49a41d122)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:09.965244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.032586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 971/1915] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:10.041851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.049036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.064215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d84836d1424e2aa0e3b3b49a41d122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.066942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:10.089271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034c00e-cf3c-454a-9994-99c7f0905dbc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.102512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d84836d1424e2aa0e3b3b49a41d122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.103547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.104454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.104738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.105052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] PATH_INFO: `/v3/users/254a60d959984a1789369eefdfcca9cf` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.108317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] RBAC: Authorizing `identity:delete_user(user_id=254a60d959984a1789369eefdfcca9cf)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.110288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.119632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d84836d1424e2aa0e3b3b49a41d122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.121315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d84836d1424e2aa0e3b3b49a41d122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.157462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-da209ef2-4cdc-4a70-bc8f-09b38ac8f943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d84836d1424e2aa0e3b3b49a41d122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.172882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 945/1916] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:09 2022] DELETE /identity/v3/users/d9d84836d1424e2aa0e3b3b49a41d122 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:10.174307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4125c7-c302-4a10-9f63-78da47ad0859 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.175523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4125c7-c302-4a10-9f63-78da47ad0859 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.176019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4125c7-c302-4a10-9f63-78da47ad0859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.224977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ed4125c7-c302-4a10-9f63-78da47ad0859 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:10.224977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ed4125c7-c302-4a10-9f63-78da47ad0859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.272244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254a60d959984a1789369eefdfcca9cf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.292456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254a60d959984a1789369eefdfcca9cf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.301181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254a60d959984a1789369eefdfcca9cf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.302018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254a60d959984a1789369eefdfcca9cf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.308753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 946/1917] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:10.308753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86e38-0bde-4494-99a9-1c76767e11fe None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.308753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86e38-0bde-4494-99a9-1c76767e11fe None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.308753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86e38-0bde-4494-99a9-1c76767e11fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.316528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254a60d959984a1789369eefdfcca9cf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:10.330042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 972/1918] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:10 2022] DELETE /identity/v3/users/254a60d959984a1789369eefdfcca9cf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:10.331233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.331485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-50e86e38-0bde-4494-99a9-1c76767e11fe None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:10.332962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-50e86e38-0bde-4494-99a9-1c76767e11fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.333780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.415814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 947/1919] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:10.420114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.420417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.421016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.452226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:10.453535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.457859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cd5e-10b8-40bd-b61e-82979306923a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.463635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 948/1920] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:10.464583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.465425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.465915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.476090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.476090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.476090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.476090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:10.476090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.476445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.493720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 973/1921] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:10.494481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.498379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:10.527141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:10.530735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ffae1-7e7c-4133-b1ba-8ea74fc1ac9f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.536824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.540043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.540338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.540623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.551214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.552701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.562311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 949/1922] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:10.563152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.565190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3703456-bd23-4781-bb07-115a626077fd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.568437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:10.569947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.570777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.571249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.571396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.573771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2ca2-e2af-472d-93e4-cd5c94e2343d service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.582682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.582845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.583479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.583831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.584117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.584226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.584846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.586921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.594899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 974/1923] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:10.619349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 950/1924] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:10 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:10.623413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.633687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27596e7-373b-4295-b32c-d56effe4bee8 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.694943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.695713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.696004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.696293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.697103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.699168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.723055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 975/1925] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:10 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:10.724437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.736067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb985d0-5352-47a4-b142-4c01a9052e03 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.754202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.754955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.755242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.756139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.758410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.758996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.772366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 951/1926] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:10.781768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.796480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252078a-c3af-4df1-8f93-a2a3cd46ee22 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.803409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c6f3-afaa-4d77-9a55-23b2472fb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.804230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c6f3-afaa-4d77-9a55-23b2472fb040 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.804656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c6f3-afaa-4d77-9a55-23b2472fb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.804820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c6f3-afaa-4d77-9a55-23b2472fb040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.805952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c6f3-afaa-4d77-9a55-23b2472fb040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.809205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c6f3-afaa-4d77-9a55-23b2472fb040 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.824434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 976/1927] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:10.826115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:10.839375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66eecd-9b47-4272-9091-2488ef01ef7a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:10.844730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:10.847500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.851148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.851148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] PATH_INFO: `/v3/projects/c11ec8b9b7464abcbdbac912a0bfca84/users/22223d0c3f9d47d0847049e35ab05df5/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.872160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11ec8b9b7464abcbdbac912a0bfca84, user_id=22223d0c3f9d47d0847049e35ab05df5, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:10.875284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:10.894367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 952/1928] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:10 2022] PUT /identity/v3/projects/c11ec8b9b7464abcbdbac912a0bfca84/users/22223d0c3f9d47d0847049e35ab05df5/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:10.907124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:10.907425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:10.907713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:10.944339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] MFA Rules not processed for user `22223d0c3f9d47d0847049e35ab05df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:10.945628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.037406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.040605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.072543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 977/1929] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:11.076737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.137214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:11.140431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1085d-84f3-4d92-b844-69dde2f61231 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.149305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.152110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.153001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.153401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] PATH_INFO: `/v3/projects/f9d09549bdc84db790eb3d54bcc53798` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.155218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d09549bdc84db790eb3d54bcc53798)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.158104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.207010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3779-a22d-4534-a6d2-1b6e961a3e50 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.216819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.217546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.217991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.218258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.219134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.221355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.250296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d09549bdc84db790eb3d54bcc53798', 'request_id': 'req-22ad42ed-0e71-409f-8858-b84c0467bd1b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.257682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d09549bdc84db790eb3d54bcc53798', 'request_id': 'req-22ad42ed-0e71-409f-8858-b84c0467bd1b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.272222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 978/1930] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:11 2022] POST /identity/v3/projects => generated 401 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:11.272222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.272402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d09549bdc84db790eb3d54bcc53798', 'request_id': 'req-22ad42ed-0e71-409f-8858-b84c0467bd1b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.275238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.292132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] The token cache is being invalidate because project f9d09549bdc84db790eb3d54bcc53798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:11.292463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.293506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.295268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 953/1931] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:11 2022] DELETE /identity/v3/projects/f9d09549bdc84db790eb3d54bcc53798 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:11.296070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.297839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.346129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:11.371899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad42ed-0e71-409f-8858-b84c0467bd1b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.376139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5438ae-59fd-44c5-a329-31cccdd7615d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.376300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.376966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.377443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.377443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.378347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.380472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.382320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.383284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.383633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.383975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] PATH_INFO: `/v3/projects/5206200b32f84b2caa25da78837d5d3d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.385264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5206200b32f84b2caa25da78837d5d3d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.387234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.404853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 954/1932] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:11 2022] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:11.414836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.416550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.429114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bd57-89ed-48a2-84e4-0c2eedf5e2f2 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.434041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.435007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.435377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.435560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] PATH_INFO: `/v3/users/6475e0951656476ea80dd6060f401bda` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.436815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6475e0951656476ea80dd6060f401bda)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.438965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.462844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5206200b32f84b2caa25da78837d5d3d', 'request_id': 'req-fc417c0a-915a-4ace-9b21-22cf0c3caff8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.468983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5206200b32f84b2caa25da78837d5d3d', 'request_id': 'req-fc417c0a-915a-4ace-9b21-22cf0c3caff8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.479802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5206200b32f84b2caa25da78837d5d3d', 'request_id': 'req-fc417c0a-915a-4ace-9b21-22cf0c3caff8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.500302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] The token cache is being invalidate because project 5206200b32f84b2caa25da78837d5d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:11.503694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.505339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.507149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 979/1933] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:11 2022] DELETE /identity/v3/projects/5206200b32f84b2caa25da78837d5d3d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:11.508059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.509556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.520657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6475e0951656476ea80dd6060f401bda'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.535603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6475e0951656476ea80dd6060f401bda'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.543217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6475e0951656476ea80dd6060f401bda'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.544168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6475e0951656476ea80dd6060f401bda'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.554912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4ca6a509-1ba9-433c-92bb-da08876ef415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6475e0951656476ea80dd6060f401bda'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:11.562747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 955/1934] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:11 2022] DELETE /identity/v3/users/6475e0951656476ea80dd6060f401bda => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:11.567015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbbfc3-590f-44cf-aa6b-5a42f4a63193 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.567309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbbfc3-590f-44cf-aa6b-5a42f4a63193 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.567597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbbfc3-590f-44cf-aa6b-5a42f4a63193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.574948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:11.596217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-39bbbfc3-590f-44cf-aa6b-5a42f4a63193 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:11.597919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-39bbbfc3-590f-44cf-aa6b-5a42f4a63193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.607395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc417c0a-915a-4ace-9b21-22cf0c3caff8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.672074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 956/1935] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:11.675716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.676009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.676288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.685520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.686657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.686946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.687220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.688463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.690837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.700693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:11.702356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.707749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 980/1936] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:11.712065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.714561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:11.719171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 957/1937] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:11.720398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.731986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf3a94-6ed9-4578-9c25-8ceb7e67a41e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.740238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059e88c-0053-4589-8b72-246066510fe8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.745488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.746990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.747109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.747388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] PATH_INFO: `/v3/projects/def25753d7b54ef3a929ade77e2ee218/users/d823ece1f96c44a2b3b18ce0019955e0/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.750160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.753342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.756216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.756603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.757740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:11.759218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.764357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.781894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def25753d7b54ef3a929ade77e2ee218, user_id=d823ece1f96c44a2b3b18ce0019955e0, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.786208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.799502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 958/1938] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:11.802650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.820796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 981/1939] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:11 2022] PUT /identity/v3/projects/def25753d7b54ef3a929ade77e2ee218/users/d823ece1f96c44a2b3b18ce0019955e0/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:11.822335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2f6c-058e-44e2-a738-387bd0570186 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.824440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:11.860737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:11.966084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.967340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.967340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.967837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.969066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.969709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6e65c-518d-4a81-9fb5-9be28a537cf0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:11.972297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:11.984128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:11.984824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:11.985133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:11.985417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:11.986199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:11.988816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.007698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 982/1940] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:12.009125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.011329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.028352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b109-6eed-40cd-9f1f-55d428764d2f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.033133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 959/1941] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:11 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:12.033133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.136647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.138891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.139184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.139468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] PATH_INFO: `/v3/projects/71d53930114642dbbeaf29d1b3a652bf` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.140437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aced45b-ffd9-4d68-8160-4666d54a883a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.141343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d53930114642dbbeaf29d1b3a652bf)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.144662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.157561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:12.160852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.162470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.162757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.163031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] PATH_INFO: `/v3/projects/def25753d7b54ef3a929ade77e2ee218/users/d823ece1f96c44a2b3b18ce0019955e0/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.170079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def25753d7b54ef3a929ade77e2ee218, user_id=d823ece1f96c44a2b3b18ce0019955e0, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.173762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.195402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 960/1942] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:12 2022] PUT /identity/v3/projects/def25753d7b54ef3a929ade77e2ee218/users/d823ece1f96c44a2b3b18ce0019955e0/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:12.195809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.242949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d53930114642dbbeaf29d1b3a652bf', 'request_id': 'req-0aa72923-97fa-4c88-8811-459b42429594'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:12.249205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d53930114642dbbeaf29d1b3a652bf', 'request_id': 'req-0aa72923-97fa-4c88-8811-459b42429594'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:12.257497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d53930114642dbbeaf29d1b3a652bf', 'request_id': 'req-0aa72923-97fa-4c88-8811-459b42429594'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:12.275382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] The token cache is being invalidate because project 71d53930114642dbbeaf29d1b3a652bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:12.275817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:12.277098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0aa72923-97fa-4c88-8811-459b42429594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:12.279474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 983/1943] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:12 2022] DELETE /identity/v3/projects/71d53930114642dbbeaf29d1b3a652bf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:12.280489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393199f-e04b-471c-9efb-8aaf8571631b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.280776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393199f-e04b-471c-9efb-8aaf8571631b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.281799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393199f-e04b-471c-9efb-8aaf8571631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.297132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41aff-5046-4b26-95f5-77ccbb859f09 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.311897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c393199f-e04b-471c-9efb-8aaf8571631b None None] MFA Rules not processed for user `d823ece1f96c44a2b3b18ce0019955e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:12.313149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c393199f-e04b-471c-9efb-8aaf8571631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.354630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:12.373280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.374063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.374415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.374762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.375452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.377988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.400059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 984/1944] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:12.401680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.402170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 961/1945] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:12.402273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.402506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.411628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.413318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.424817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:12.425847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541015b-947d-4631-a758-0a442ac803be admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.426055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.430730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5d5e1-051b-48b5-872d-0708d45e1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.431400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5d5e1-051b-48b5-872d-0708d45e1676 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.431685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5d5e1-051b-48b5-872d-0708d45e1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.431964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5d5e1-051b-48b5-872d-0708d45e1676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.432693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5d5e1-051b-48b5-872d-0708d45e1676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.434617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5d5e1-051b-48b5-872d-0708d45e1676 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.434729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 985/1946] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:12.437758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.443529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.448612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 962/1947] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:12.450460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.450923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.452003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.475908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:12.478585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.495386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 963/1948] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:12.496413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.511592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1a87-d8de-40a9-8ed9-4ecb165c68d3 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.522313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.523543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.524021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.524598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.526322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.529452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.542270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b685-7d95-4e61-87a1-6711800a1cba None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.546779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.550768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 964/1949] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:12.550913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.550913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.551058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.551156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.568612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.569023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.570766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2555a3-de85-4520-8e13-d539db833307 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.580769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.581484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.581766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.582590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.583666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:12.583973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.585625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.589512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 986/1950] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:12.591425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.606992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 965/1951] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:12.609389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.613903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b902d-685e-459c-a16b-18373900008c service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.620125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e05a2-a202-412b-a520-378500b646ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.621325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e05a2-a202-412b-a520-378500b646ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.621576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e05a2-a202-412b-a520-378500b646ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.622156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e05a2-a202-412b-a520-378500b646ab admin admin] PATH_INFO: `/v3/projects/52ad8e34a343476996070e6a8a4d3e26/users/457124861030491f8ec4b22b211c21bb/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.626464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458df7-9a76-46ab-a5c8-86cbae749f93 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.635582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.641002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.641002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.641002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.641002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.642289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.656005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e05a2-a202-412b-a520-378500b646ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ad8e34a343476996070e6a8a4d3e26, user_id=457124861030491f8ec4b22b211c21bb, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.659954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e05a2-a202-412b-a520-378500b646ab admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.662527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:12.684813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 987/1952] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:12 2022] PUT /identity/v3/projects/52ad8e34a343476996070e6a8a4d3e26/users/457124861030491f8ec4b22b211c21bb/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:12.696853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.697462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.697854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.712778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 966/1953] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:12.714519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.741420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] MFA Rules not processed for user `457124861030491f8ec4b22b211c21bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:12.743384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.845603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a171d4-1dce-4983-ad19-335e1b6bfd9c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.851999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.852666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.852961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.853239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.863958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.881101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 988/1954] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:12.881868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.973578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.975041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:12.984376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c941395-7b80-4c9e-9b17-1324354103cf None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:12.992081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:12.992705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 967/1955] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:12.993565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:12.993767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:12.994439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:12.994934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:12.995908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:12.996034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:12.999038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.031085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 989/1956] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:12 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:13.036266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:13.041557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:13.055602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38bf35-fca7-46fd-a4c2-e678f9603739 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:13.062434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:13.063432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.063840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.064892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.066799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:13.068838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.086272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 990/1957] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:13.089766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:13.093339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda9c6-d533-4616-8fc6-3588e13537c1 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:13.098535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:13.099379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.099663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.099984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.110738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:13.112623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.113800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005ab5-440c-48b4-a33a-3c86294e077b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:13.120604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e345f-8f64-4da5-8d2f-e9f0f776c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:13.121647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e345f-8f64-4da5-8d2f-e9f0f776c032 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.122011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e345f-8f64-4da5-8d2f-e9f0f776c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.122915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e345f-8f64-4da5-8d2f-e9f0f776c032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.123300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e345f-8f64-4da5-8d2f-e9f0f776c032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:13.125409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e345f-8f64-4da5-8d2f-e9f0f776c032 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.134438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 968/1958] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:13.139015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 991/1959] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:13.142893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:13.154260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645ab0-af64-4838-8e6c-4b0ce9aa34e5 service glance] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:13.159471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:13.160378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.160735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.161063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] PATH_INFO: `/v3/projects/d970310f6369427cbeb221105f91f539/users/b0d84f3e64394b53a18c93a88e027ff9/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.178123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d970310f6369427cbeb221105f91f539, user_id=b0d84f3e64394b53a18c93a88e027ff9, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:13.181049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.201017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 969/1960] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:13 2022] PUT /identity/v3/projects/d970310f6369427cbeb221105f91f539/users/b0d84f3e64394b53a18c93a88e027ff9/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:13.208196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.208516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.208797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.246631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] MFA Rules not processed for user `b0d84f3e64394b53a18c93a88e027ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:13.248785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:13.298143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:13.329608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 992/1961] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:13.476803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:13.557522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a7b5-0f43-4f73-82f5-7210f817b7ec admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:13.562480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dff00-b771-40a1-bf41-5e49458be4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:13.563148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dff00-b771-40a1-bf41-5e49458be4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.563430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dff00-b771-40a1-bf41-5e49458be4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.563718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dff00-b771-40a1-bf41-5e49458be4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.579101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dff00-b771-40a1-bf41-5e49458be4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:13.581246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dff00-b771-40a1-bf41-5e49458be4d6 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.591451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 970/1962] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:13.613511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:13.723928 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7599c-9ca6-4b2a-9f58-71d4faf8b839 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:13.729885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:13.730787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.731071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.731349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] PATH_INFO: `/v3/users/b0d84f3e64394b53a18c93a88e027ff9` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.732743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d84f3e64394b53a18c93a88e027ff9)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:13.735516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:13.820293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d84f3e64394b53a18c93a88e027ff9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:13.840225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d84f3e64394b53a18c93a88e027ff9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:13.852505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d84f3e64394b53a18c93a88e027ff9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:13.855494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d84f3e64394b53a18c93a88e027ff9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:13.870858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d84f3e64394b53a18c93a88e027ff9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:13.883195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 993/1963] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:13 2022] DELETE /identity/v3/users/b0d84f3e64394b53a18c93a88e027ff9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:13.887916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:13.888291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:13.888748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:13.921520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:13.923669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:14.031239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 971/1964] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:14.042174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:14.044287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:14.122796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec298a-4b87-4cd1-9133-900f517eb978 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:14.126962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd79412-fe5d-468e-b565-69175fa25e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:14.127869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79412-fe5d-468e-b565-69175fa25e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.128209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79412-fe5d-468e-b565-69175fa25e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.128552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd79412-fe5d-468e-b565-69175fa25e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.140878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79412-fe5d-468e-b565-69175fa25e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:14.142756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd79412-fe5d-468e-b565-69175fa25e42 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:14.153275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 994/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:14.460808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:14.462315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:14.477468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ceed2-2535-4446-986a-c0a8dd73819a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:14.487728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:14.488610 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.488889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.489197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] PATH_INFO: `/v3/projects/d970310f6369427cbeb221105f91f539` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.490521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d970310f6369427cbeb221105f91f539)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:14.492561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:14.538007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:14.545398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd970310f6369427cbeb221105f91f539', 'request_id': 'req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:14.551505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd970310f6369427cbeb221105f91f539', 'request_id': 'req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:14.559444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd970310f6369427cbeb221105f91f539', 'request_id': 'req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:14.571426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] The token cache is being invalidate because project d970310f6369427cbeb221105f91f539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:14.571731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:14.572345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d651c47c-f7a1-4a9f-9799-dbf82ef667c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:14.573923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 972/1966] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:14 2022] DELETE /identity/v3/projects/d970310f6369427cbeb221105f91f539 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:14.578825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.579121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.579405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.586766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:14.601378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:14.602569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:14.670135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 995/1967] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:14.679367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.679693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.679994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.706848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:14.708123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:14.720432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 973/1968] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:14.724661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:14.749185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6c8cd-1e1c-4d80-8f87-a6eb2d3ea7b9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:14.762247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:14.762942 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.763643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.764135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.765020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:14.765369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:14.770806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:14.790795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 996/1969] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:14.795246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:14.806814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61db74-911f-47c2-8cdf-d4e9a457102b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:14.825587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:14.826841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.836083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.836370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.837128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:14.839133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:14.881014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 974/1970] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:14 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:14.884965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:14.899041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e4c8a-cc78-45e0-8c03-c4e466e91880 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:14.974174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:14.974937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:14.975298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:14.975715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:14.976472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:14.978716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:15.005487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 997/1971] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:14 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:15.009355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:15.022388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df15828-f69b-4dd0-a183-644f330d44c0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:15.027700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:15.028461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:15.029048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:15.029401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:15.030285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:15.032199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:15.047957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 975/1972] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:15.048836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:15.060332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279635d5-d455-4bf2-94f3-ac4a2feec9a5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:15.068021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4aba7-c64b-4d9e-8e5b-b838da9ecba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:15.068725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4aba7-c64b-4d9e-8e5b-b838da9ecba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:15.069048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4aba7-c64b-4d9e-8e5b-b838da9ecba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:15.069339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4aba7-c64b-4d9e-8e5b-b838da9ecba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:15.070091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4aba7-c64b-4d9e-8e5b-b838da9ecba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:15.071749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4aba7-c64b-4d9e-8e5b-b838da9ecba7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:15.083459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 998/1973] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:15.087900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:15.101306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275e58-3f7e-4dca-8578-3ce8f276e0b5 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:15.108151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:15.109206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:15.109577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:15.109919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] PATH_INFO: `/v3/projects/2b863ed3affd4837ababae6bb6c515a3/users/2675a321f5754d1ab237bad9cf26b06b/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:15.135650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b863ed3affd4837ababae6bb6c515a3, user_id=2675a321f5754d1ab237bad9cf26b06b, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:15.139046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:15.158586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 976/1974] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:15 2022] PUT /identity/v3/projects/2b863ed3affd4837ababae6bb6c515a3/users/2675a321f5754d1ab237bad9cf26b06b/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:15.169399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:15.169745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:15.169962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:15.202851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] MFA Rules not processed for user `2675a321f5754d1ab237bad9cf26b06b`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:15.204223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:15.266622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:15.272647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 999/1975] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:15.284540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:15.286483 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:15.343246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fa410-81d5-430d-b560-fab1f4718810 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:15.347051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c725c-f10f-49fe-8869-a724227e7504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:15.347694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c725c-f10f-49fe-8869-a724227e7504 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:15.347982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c725c-f10f-49fe-8869-a724227e7504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:15.348259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c725c-f10f-49fe-8869-a724227e7504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:15.356504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c725c-f10f-49fe-8869-a724227e7504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:15.358046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c725c-f10f-49fe-8869-a724227e7504 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:15.367263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 977/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:18.593092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:18.595241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:18.676328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84943d4c-8d34-45d2-abef-a78afb375a05 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:18.681803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:18.683083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:18.683083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:18.683265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] PATH_INFO: `/v3/users/22223d0c3f9d47d0847049e35ab05df5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:18.684528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22223d0c3f9d47d0847049e35ab05df5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:18.686567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:18.735616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22223d0c3f9d47d0847049e35ab05df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:18.750913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22223d0c3f9d47d0847049e35ab05df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:18.769971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22223d0c3f9d47d0847049e35ab05df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:18.770700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22223d0c3f9d47d0847049e35ab05df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:18.779696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22223d0c3f9d47d0847049e35ab05df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:18.787879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1000/1977] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:18 2022] DELETE /identity/v3/users/22223d0c3f9d47d0847049e35ab05df5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:18.792578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:18.793132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:18.793279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:18.812663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:18.813908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:18.872865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 978/1978] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:18.883104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:18.884490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:18.943761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924ddb1-ae15-4596-8c40-e3d3c4cb6ad8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:18.947719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:18.948374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:18.948662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:18.948959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:18.959293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:18.960750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:18.970820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1001/1979] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:19.252112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:19.253678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:19.265481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f597fa-308f-4cf2-af7e-9fcb3e29506c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:19.270203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:19.271077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:19.271340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:19.272415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] PATH_INFO: `/v3/projects/c11ec8b9b7464abcbdbac912a0bfca84` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:19.273813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11ec8b9b7464abcbdbac912a0bfca84)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:19.275752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:19.279855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:19.330262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11ec8b9b7464abcbdbac912a0bfca84', 'request_id': 'req-457fddb0-535f-413f-9283-6b40c7f405b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.335284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11ec8b9b7464abcbdbac912a0bfca84', 'request_id': 'req-457fddb0-535f-413f-9283-6b40c7f405b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.342407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11ec8b9b7464abcbdbac912a0bfca84', 'request_id': 'req-457fddb0-535f-413f-9283-6b40c7f405b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.354598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] The token cache is being invalidate because project c11ec8b9b7464abcbdbac912a0bfca84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:19.354883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.355521 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.357079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 979/1980] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:19 2022] DELETE /identity/v3/projects/c11ec8b9b7464abcbdbac912a0bfca84 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:19.361056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:19.371340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c04c9-833b-47c9-86bc-66b3f16dd87e service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:19.389910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:19.441174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:19.442068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:19.442353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:19.442684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] PATH_INFO: `/v3/users/d823ece1f96c44a2b3b18ce0019955e0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:19.443947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d823ece1f96c44a2b3b18ce0019955e0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:19.445954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:19.496615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd823ece1f96c44a2b3b18ce0019955e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.509924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd823ece1f96c44a2b3b18ce0019955e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.517518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd823ece1f96c44a2b3b18ce0019955e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.520857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd823ece1f96c44a2b3b18ce0019955e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.528719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5d1a2dc8-c097-4712-9e87-e9ddbfeb686c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd823ece1f96c44a2b3b18ce0019955e0'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.535770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1002/1981] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:19 2022] DELETE /identity/v3/users/d823ece1f96c44a2b3b18ce0019955e0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:19.806733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:19.808246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:19.822557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fddb0-535f-413f-9283-6b40c7f405b9 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:19.893924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:19.895416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:19.895708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:19.895981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] PATH_INFO: `/v3/projects/def25753d7b54ef3a929ade77e2ee218` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:19.897279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def25753d7b54ef3a929ade77e2ee218)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:19.899214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:19.949022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def25753d7b54ef3a929ade77e2ee218', 'request_id': 'req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.955041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def25753d7b54ef3a929ade77e2ee218', 'request_id': 'req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.964290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def25753d7b54ef3a929ade77e2ee218', 'request_id': 'req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.977407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] The token cache is being invalidate because project def25753d7b54ef3a929ade77e2ee218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:19.977407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.978257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e8b43b8b-8b6c-4903-ab4c-f48a058915c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:19.980426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 980/1982] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:19 2022] DELETE /identity/v3/projects/def25753d7b54ef3a929ade77e2ee218 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:19.986098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:19.986673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:19.986754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.006844 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:20.008071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:20.079867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1003/1983] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:20.088965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.089168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.089335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.108886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:20.110110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:20.118678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 981/1984] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:20.122912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.132981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7d306-94d8-46ec-82d6-0afdb6b3b785 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.137533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.138188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.138470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.138744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.139464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:20.139767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.141408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.156564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1004/1985] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:20.157797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.168078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1133ff-d1cd-42f7-aaa2-c55bc0a52281 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.172751 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.173437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.173717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.174137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.174827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.176732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.190326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:20.206280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 982/1986] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:20 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:20.210635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.223064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1113621-b343-4a57-8e0d-404d7054ae09 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.250831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:20.287374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.288025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.288346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.288545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.289352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.291194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.310823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1005/1987] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:20 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:20.314888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.324886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8febb2-7df0-406b-898a-7be93f2dbb85 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.329417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.330065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.331010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.331303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.332017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.333641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.343830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 983/1988] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:20.348609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.358745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1ff-e5a6-4c13-890c-0411fd5218bd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.363450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b8fae-ed35-42ea-90bd-a6d90f83f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.364100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b8fae-ed35-42ea-90bd-a6d90f83f593 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.364380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b8fae-ed35-42ea-90bd-a6d90f83f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.364654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b8fae-ed35-42ea-90bd-a6d90f83f593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.365397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b8fae-ed35-42ea-90bd-a6d90f83f593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.367168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b8fae-ed35-42ea-90bd-a6d90f83f593 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.377529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1006/1989] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:20.381869 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.392125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed19f0-3b75-4e62-af1b-a867ac84c9ae admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.397648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.398540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.398823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.399096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] PATH_INFO: `/v3/projects/392920afa6ea456abc3b68e3fc13aff0/users/f59a0812c76b48e9ab359edfeec7bb7c/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.414643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=392920afa6ea456abc3b68e3fc13aff0, user_id=f59a0812c76b48e9ab359edfeec7bb7c, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.417373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.429833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 984/1990] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:20 2022] PUT /identity/v3/projects/392920afa6ea456abc3b68e3fc13aff0/users/f59a0812c76b48e9ab359edfeec7bb7c/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:20.439767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.440052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.440504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.467317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] MFA Rules not processed for user `f59a0812c76b48e9ab359edfeec7bb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:20.468505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:20.534491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1007/1991] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:20.546360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:20.548045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:20.607102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c57333-1fd4-4528-839e-a689969666a3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:20.610891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0603c-9528-403c-9b09-34a1c25d05c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:20.611987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0603c-9528-403c-9b09-34a1c25d05c3 service glance] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:20.612358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0603c-9528-403c-9b09-34a1c25d05c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:20.612750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0603c-9528-403c-9b09-34a1c25d05c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:20.621687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0603c-9528-403c-9b09-34a1c25d05c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:20.623475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0603c-9528-403c-9b09-34a1c25d05c3 service glance] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:20.632790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 985/1992] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:24.354439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:24.355879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:24.429776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3815a-6780-4b9e-bde5-60e2b8e02c7f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:24.435042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:24.436047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:24.436396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:24.436860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] PATH_INFO: `/v3/users/6e23d1770f5d49cb8634649589fc75dd` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:24.438210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e23d1770f5d49cb8634649589fc75dd)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:24.441543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:24.489516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:24.500315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e23d1770f5d49cb8634649589fc75dd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:24.514880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e23d1770f5d49cb8634649589fc75dd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:24.524421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e23d1770f5d49cb8634649589fc75dd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:24.525226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e23d1770f5d49cb8634649589fc75dd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:24.536688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e23d1770f5d49cb8634649589fc75dd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:24.543116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1008/1993] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:24 2022] DELETE /identity/v3/users/6e23d1770f5d49cb8634649589fc75dd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:24.547817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:24.548332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:24.548522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:24.568215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:24.569254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:24.633555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 986/1994] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:24.643277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:24.644751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:24.705808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611f568-a290-4aff-8932-c3cb288800b9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:24.709613 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:24.710424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:24.710712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:24.710995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:24.721770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:24.723227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:24.733557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1009/1995] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:25.138586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:25.139761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:25.154156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a575-5d42-43b7-9f58-3233e6b1d851 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:25.162164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:25.163039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:25.163316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:25.163587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] PATH_INFO: `/v3/projects/ede12b3bad6041dfa97cf6d91e6d097b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:25.165938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede12b3bad6041dfa97cf6d91e6d097b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:25.168641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:25.169957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:25.172533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:25.218442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c63e8-ddfe-4358-939c-774a7a7706c9 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:25.224434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:25.225601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:25.225958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:25.226572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] PATH_INFO: `/v3/users/2675a321f5754d1ab237bad9cf26b06b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:25.227842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2675a321f5754d1ab237bad9cf26b06b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:25.229887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:25.257766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede12b3bad6041dfa97cf6d91e6d097b', 'request_id': 'req-92925a35-b4aa-4904-8102-5559de93d4f6'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.270037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:25.271480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede12b3bad6041dfa97cf6d91e6d097b', 'request_id': 'req-92925a35-b4aa-4904-8102-5559de93d4f6'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.292438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede12b3bad6041dfa97cf6d91e6d097b', 'request_id': 'req-92925a35-b4aa-4904-8102-5559de93d4f6'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.301416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2675a321f5754d1ab237bad9cf26b06b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.311471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] The token cache is being invalidate because project ede12b3bad6041dfa97cf6d91e6d097b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:25.312028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.313416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.315835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 987/1996] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:25 2022] DELETE /identity/v3/projects/ede12b3bad6041dfa97cf6d91e6d097b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:25.317195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2675a321f5754d1ab237bad9cf26b06b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.320744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:25.321801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:25.325878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2675a321f5754d1ab237bad9cf26b06b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.326623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2675a321f5754d1ab237bad9cf26b06b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.339959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-2095e77c-0f35-45e3-ba63-0aec391a9627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2675a321f5754d1ab237bad9cf26b06b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.353775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1010/1997] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:25 2022] DELETE /identity/v3/users/2675a321f5754d1ab237bad9cf26b06b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:25.358312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:25.359411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:25.359796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:25.380197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:25.381726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:25.418031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:25.436456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925a35-b4aa-4904-8102-5559de93d4f6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:25.466210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1011/1998] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:25.480759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:25.483196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:25.527258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:25.528274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:25.528568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:25.529024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] PATH_INFO: `/v3/users/5228a95fdf2e4614951003450985843b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:25.530409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5228a95fdf2e4614951003450985843b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:25.532401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:25.553316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bf2cc-e97a-404a-82f3-4b65733023de None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:25.561631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:25.562460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:25.563020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:25.563132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:25.574403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:25.576116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:25.590477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1012/1999] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:25.598251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5228a95fdf2e4614951003450985843b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.616507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5228a95fdf2e4614951003450985843b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.625317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5228a95fdf2e4614951003450985843b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.626389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5228a95fdf2e4614951003450985843b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.636583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5228a95fdf2e4614951003450985843b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:25.645208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 988/2000] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:25 2022] DELETE /identity/v3/users/5228a95fdf2e4614951003450985843b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:26.028920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.031342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.046073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf66a-06ca-4876-b619-06f49f40222e service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.115148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.116026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.116310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.116585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] PATH_INFO: `/v3/projects/2b863ed3affd4837ababae6bb6c515a3` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.117829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b863ed3affd4837ababae6bb6c515a3)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.120019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.163661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.165343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.181145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ecd19-b42e-4da7-83c9-8f28496531e8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.190548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:26.207492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b863ed3affd4837ababae6bb6c515a3', 'request_id': 'req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.224368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b863ed3affd4837ababae6bb6c515a3', 'request_id': 'req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.233286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b863ed3affd4837ababae6bb6c515a3', 'request_id': 'req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.248975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] The token cache is being invalidate because project 2b863ed3affd4837ababae6bb6c515a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:26.249287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.251047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1da2b868-dba7-4c42-a0c1-b8f2cb3038d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.254065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1013/2001] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:26 2022] DELETE /identity/v3/projects/2b863ed3affd4837ababae6bb6c515a3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:26.259794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c73ca-ebc5-4f7d-8ad9-8a254b0f26c1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.259943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.260110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c73ca-ebc5-4f7d-8ad9-8a254b0f26c1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.260528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c73ca-ebc5-4f7d-8ad9-8a254b0f26c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.260767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.261149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.261375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] PATH_INFO: `/v3/projects/2c7bcafed44e4603bb65bc0fb7245d9d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.262571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7bcafed44e4603bb65bc0fb7245d9d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.264490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.268038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:26.287611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-788c73ca-ebc5-4f7d-8ad9-8a254b0f26c1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:26.289196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-788c73ca-ebc5-4f7d-8ad9-8a254b0f26c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.300900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1014/2002] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:26.309441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.310160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.310879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.337575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7bcafed44e4603bb65bc0fb7245d9d', 'request_id': 'req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.341789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:26.343414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.344005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7bcafed44e4603bb65bc0fb7245d9d', 'request_id': 'req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.362665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7bcafed44e4603bb65bc0fb7245d9d', 'request_id': 'req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.376130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] The token cache is being invalidate because project 2c7bcafed44e4603bb65bc0fb7245d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:26.376326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.377616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-bcc0c517-c348-4e75-abc9-d2a4d0f0be58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:26.379606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 989/2003] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:26 2022] DELETE /identity/v3/projects/2c7bcafed44e4603bb65bc0fb7245d9d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:26.384058 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359ada-79b2-4abe-baf8-ccbb9fb58427 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.384568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359ada-79b2-4abe-baf8-ccbb9fb58427 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.384679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359ada-79b2-4abe-baf8-ccbb9fb58427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.409750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-25359ada-79b2-4abe-baf8-ccbb9fb58427 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:26.410997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-25359ada-79b2-4abe-baf8-ccbb9fb58427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.427803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1015/2004] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:26.431795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.441344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aacf9a-4ca8-49c2-a33f-cbad4d876a3d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.445978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.446620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.446899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.447171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.447892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:26.448202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.449811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.468542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1016/2005] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:26.472966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.484037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 990/2006] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:26.492955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.493447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289e70d-95a8-4e36-a8b0-d176d3db7dfd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.493570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.493921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.498894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.499589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.499877 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.500154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.500845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.503428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.514253 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:26.515458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.524462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 991/2007] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:26.529303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.540015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1017/2008] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:26.540499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dea1a-9fa0-412c-b74d-df48a29514f8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.544025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.579014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:26.607794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.608588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.608885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.609254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.609895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:26.610198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.612575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.619018 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9d7b7-0758-466a-baf7-47f4836a6306 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.625017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 992/2009] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:26.630152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.630558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.631220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.631506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.631783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.632479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.634468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.640891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8bd01-38f8-4835-aa67-853e7845b9fb admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.647175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.647868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.648179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.648448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.649170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.651084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.655997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1018/2010] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:26.660857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.671350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629ed3-cac3-4412-8dd1-5242531c7e2e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.677234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.677883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.678162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.678432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.679156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.681251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.691677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 993/2011] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:26.693684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.698897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1019/2012] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:26.700102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.710907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b4de4-6bb4-4a2a-8834-76bc28f3c70e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.755449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:26.764353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8280a2-2cf8-44ab-9257-5b9f95ee3ff5 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.771639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.772320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.772601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.772956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.776966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.776966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.777753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.778432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.778719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.778995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.779730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.781583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.793967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1020/2013] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:26.798193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.805232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 994/2014] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:26.806437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.809615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565caa-d59b-4629-9cf1-cfa512dd0bd0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.816177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d507b-c080-4100-b20a-a309f134e011 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.820820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.821511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.821800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.822076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.822859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.824462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.824904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.825836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.826123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.826391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] PATH_INFO: `/v3/projects/ec40f9ee57d64ea7afb71f5b206db45f/users/dbaf8d97902f462f8860b4818e8aaeef/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.838200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 995/2015] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:26.839448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.851336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec40f9ee57d64ea7afb71f5b206db45f, user_id=dbaf8d97902f462f8860b4818e8aaeef, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.851887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a512f6-ff7d-415d-addc-708a1b26b73b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.854392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.857462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346fe54-5879-4f8a-b019-908de406cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.858539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346fe54-5879-4f8a-b019-908de406cd3e admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.858539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346fe54-5879-4f8a-b019-908de406cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.858792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346fe54-5879-4f8a-b019-908de406cd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.859519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346fe54-5879-4f8a-b019-908de406cd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:26.862503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346fe54-5879-4f8a-b019-908de406cd3e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:26.873977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1021/2016] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:26 2022] PUT /identity/v3/projects/ec40f9ee57d64ea7afb71f5b206db45f/users/dbaf8d97902f462f8860b4818e8aaeef/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:26.882777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 996/2017] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:26.886952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:26.893604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.894466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.896803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:26.937749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] MFA Rules not processed for user `dbaf8d97902f462f8860b4818e8aaeef`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:26.939103 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:26.980346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324742b3-0940-49b9-8257-d46422b9040c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:26.987880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da120c7-e749-4249-b2ef-754fc4a0eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:26.989380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da120c7-e749-4249-b2ef-754fc4a0eb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:26.989380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da120c7-e749-4249-b2ef-754fc4a0eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:26.989712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da120c7-e749-4249-b2ef-754fc4a0eb18 admin admin] PATH_INFO: `/v3/projects/43a71eb4ff994fa78bbd278a6d5188d1/users/1aa4fe51ad254e8b9d54c85b11d16400/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.014937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da120c7-e749-4249-b2ef-754fc4a0eb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a71eb4ff994fa78bbd278a6d5188d1, user_id=1aa4fe51ad254e8b9d54c85b11d16400, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.019918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da120c7-e749-4249-b2ef-754fc4a0eb18 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.031817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 997/2018] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:27.041681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.047719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1022/2019] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:26 2022] PUT /identity/v3/projects/43a71eb4ff994fa78bbd278a6d5188d1/users/1aa4fe51ad254e8b9d54c85b11d16400/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:27.049986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:27.055040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd6984-eb90-4e85-909a-3ca0c028ca01 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.058841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.059245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.059624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.097989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] MFA Rules not processed for user `1aa4fe51ad254e8b9d54c85b11d16400`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:27.100424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:27.127744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.128952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.129532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.130078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.131536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.134057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.168678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 998/2020] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:27.170038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.174881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1023/2021] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:27.179007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.194869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b2e85-6d8c-43bf-bc33-056a3826eca7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.223194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:27.251456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7454ed0-d332-442d-986f-e6c98981a008 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.256946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.257749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.258159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.258515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.259287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.261262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.270893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.271572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.272422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.272422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.272904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.275235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.284372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 999/2022] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:27.288041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.298199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf3d38-47c0-46a3-ba8b-3cb7e1108ec1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.303192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.304074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.304755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.305210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.306097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.307723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.313262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1024/2023] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:27.322000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.322244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1000/2024] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:27.326537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.342140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddb6e1-b1bb-4229-ab7e-573691209b7d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.418518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19df4af-c8cb-4a27-a258-ced42dbda9b6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.418646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.418646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.418646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.418646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] PATH_INFO: `/v3/projects/658a7ede664b4dd38e7855a5712a1f9c/users/3f913f5d0c504f0c805281b7bdf75122/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.418980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.418980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.418980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.418980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.419308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.420146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.430241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:27.435456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658a7ede664b4dd38e7855a5712a1f9c, user_id=3f913f5d0c504f0c805281b7bdf75122, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.441679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.446701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1025/2025] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:27.451866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.463144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6b449-407d-4abd-9e96-01efb7b75bc9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.463779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1001/2026] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:27 2022] PUT /identity/v3/projects/658a7ede664b4dd38e7855a5712a1f9c/users/3f913f5d0c504f0c805281b7bdf75122/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:27.467691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.543172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.545234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.545676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.546130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.547398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.549656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.552496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790875b-8b15-4972-b522-bf3075c29d30 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.557579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.558257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.558540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.558806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.559531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.565022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.568819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1026/2027] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:27.573175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.577109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1002/2028] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:27.577982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.590802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a875d-5c04-491f-b0ad-11aa59fb25ed admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.596395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.597372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.597739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.598167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] PATH_INFO: `/v3/projects/f6e03e2647af4aaf818c667d40e98a69/users/562120bbaab545d7ad55b0a8beb57d05/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.598282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0ae31-4fcb-4d27-9469-1ce1713bd6a8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.603385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ee4b6-d71e-45ea-bab6-55d89ed0521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.604491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ee4b6-d71e-45ea-bab6-55d89ed0521d admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.605175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ee4b6-d71e-45ea-bab6-55d89ed0521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.605455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ee4b6-d71e-45ea-bab6-55d89ed0521d admin admin] PATH_INFO: `/v3/projects/658a7ede664b4dd38e7855a5712a1f9c/users/3f913f5d0c504f0c805281b7bdf75122/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.608618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ee4b6-d71e-45ea-bab6-55d89ed0521d admin admin] RBAC: Authorizing `identity:create_grant(project_id=658a7ede664b4dd38e7855a5712a1f9c, user_id=3f913f5d0c504f0c805281b7bdf75122, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.613098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ee4b6-d71e-45ea-bab6-55d89ed0521d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.626187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e03e2647af4aaf818c667d40e98a69, user_id=562120bbaab545d7ad55b0a8beb57d05, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.627435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1003/2029] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:27 2022] PUT /identity/v3/projects/658a7ede664b4dd38e7855a5712a1f9c/users/3f913f5d0c504f0c805281b7bdf75122/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:27.629985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.639007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.639300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.639608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.653190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1027/2030] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:27 2022] PUT /identity/v3/projects/f6e03e2647af4aaf818c667d40e98a69/users/562120bbaab545d7ad55b0a8beb57d05/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:27.656821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.669815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] MFA Rules not processed for user `3f913f5d0c504f0c805281b7bdf75122`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:27.670262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:27.671014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:27.725512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4ced9-5e9a-4b13-a6c4-f6a0867b52ba admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.730494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.731166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.731451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.731845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.732581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.734254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.744763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1028/2031] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:27.748971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1004/2032] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:27.749101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.759008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fdfc-da04-4e0e-89a6-5875e2179af4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.759884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.766046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:27.766171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee0dbd-7f46-41cc-8ecb-0ee29ca395ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.766171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0dbd-7f46-41cc-8ecb-0ee29ca395ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.766171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0dbd-7f46-41cc-8ecb-0ee29ca395ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.766171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0dbd-7f46-41cc-8ecb-0ee29ca395ed admin admin] PATH_INFO: `/v3/projects/f6e03e2647af4aaf818c667d40e98a69/users/562120bbaab545d7ad55b0a8beb57d05/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.767918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee0dbd-7f46-41cc-8ecb-0ee29ca395ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e03e2647af4aaf818c667d40e98a69, user_id=562120bbaab545d7ad55b0a8beb57d05, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.770792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee0dbd-7f46-41cc-8ecb-0ee29ca395ed admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.782171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1029/2033] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:27 2022] PUT /identity/v3/projects/f6e03e2647af4aaf818c667d40e98a69/users/562120bbaab545d7ad55b0a8beb57d05/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:27.792890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.793317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.793525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.826653 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] MFA Rules not processed for user `562120bbaab545d7ad55b0a8beb57d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:27.827876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:27.832326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c57c5-5341-4fd7-a3d3-0f7af9871399 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.847708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:27.900206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac32f30-2946-4dd9-88c5-7bf148657139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.900875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32f30-2946-4dd9-88c5-7bf148657139 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.901191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32f30-2946-4dd9-88c5-7bf148657139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.901838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32f30-2946-4dd9-88c5-7bf148657139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.912381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1030/2034] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:27.923499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:27.925286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:27.936817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36c735-07d9-4854-92a0-0313fa967783 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:27.941096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:27.941771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:27.942052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:27.942327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:27.954461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.956726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.967486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1031/2035] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:55:27.968053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac32f30-2946-4dd9-88c5-7bf148657139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:27.969735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac32f30-2946-4dd9-88c5-7bf148657139 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:27.981633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1005/2036] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:55:28.490470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:28.555899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27412087-09cb-476c-b1fe-26851551ffb6 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:28.560912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:28.561827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:28.562113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:28.562390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] PATH_INFO: `/v3/users/1aa4fe51ad254e8b9d54c85b11d16400` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:28.563612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa4fe51ad254e8b9d54c85b11d16400)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:28.572016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:28.582641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:28.667674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa4fe51ad254e8b9d54c85b11d16400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:28.694602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa4fe51ad254e8b9d54c85b11d16400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:28.701982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa4fe51ad254e8b9d54c85b11d16400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:28.702700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa4fe51ad254e8b9d54c85b11d16400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:28.711721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa4fe51ad254e8b9d54c85b11d16400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:28.721677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1032/2037] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:28 2022] DELETE /identity/v3/users/1aa4fe51ad254e8b9d54c85b11d16400 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:28.726387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:28.727075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:28.727075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:28.750741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:28.752335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:28.834071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1006/2038] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:28.849433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:28.851099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:28.929692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee41c-3f30-45b1-a8b3-7324c4b8f463 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:28.933452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:28.934192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:28.934559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:28.934902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:28.944640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:28.946219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:28.956645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1033/2039] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:30.081472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:30.083166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:30.096456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd65d7-894c-4822-965f-29e2a3007178 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:30.101927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:30.102978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:30.103296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:30.103601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] PATH_INFO: `/v3/projects/43a71eb4ff994fa78bbd278a6d5188d1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:30.105131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a71eb4ff994fa78bbd278a6d5188d1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:30.107004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:30.172249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a71eb4ff994fa78bbd278a6d5188d1', 'request_id': 'req-11955d88-8f0a-4527-b10e-0e8968256662'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.182340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a71eb4ff994fa78bbd278a6d5188d1', 'request_id': 'req-11955d88-8f0a-4527-b10e-0e8968256662'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.191184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a71eb4ff994fa78bbd278a6d5188d1', 'request_id': 'req-11955d88-8f0a-4527-b10e-0e8968256662'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.192978 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:30.210392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] The token cache is being invalidate because project 43a71eb4ff994fa78bbd278a6d5188d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:30.211157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.212608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.215343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1007/2040] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:30 2022] DELETE /identity/v3/projects/43a71eb4ff994fa78bbd278a6d5188d1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:30.219404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:30.230517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c381ecc-e8ec-46c1-bd74-3fd4ea4495d3 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:30.315745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:30.316648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:30.316945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:30.317231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] PATH_INFO: `/v3/users/562120bbaab545d7ad55b0a8beb57d05` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:30.319287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562120bbaab545d7ad55b0a8beb57d05)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:30.321818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:30.379388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:30.406125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562120bbaab545d7ad55b0a8beb57d05'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.425079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562120bbaab545d7ad55b0a8beb57d05'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.433826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562120bbaab545d7ad55b0a8beb57d05'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.434692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562120bbaab545d7ad55b0a8beb57d05'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.445069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9f2dcab7-0b0a-4286-a0f5-7fb9b9ff7591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562120bbaab545d7ad55b0a8beb57d05'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:30.454320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1034/2041] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:30 2022] DELETE /identity/v3/users/562120bbaab545d7ad55b0a8beb57d05 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:30.718653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:30.721362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:30.735543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955d88-8f0a-4527-b10e-0e8968256662 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:30.861133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:30.876227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:30.877409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:30.878409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] PATH_INFO: `/v3/users/dbaf8d97902f462f8860b4818e8aaeef` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:30.880459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbaf8d97902f462f8860b4818e8aaeef)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:30.883089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:30.982825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbaf8d97902f462f8860b4818e8aaeef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.006930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbaf8d97902f462f8860b4818e8aaeef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.027099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbaf8d97902f462f8860b4818e8aaeef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.028168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbaf8d97902f462f8860b4818e8aaeef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.038612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbaf8d97902f462f8860b4818e8aaeef'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.055468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1008/2042] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:30 2022] DELETE /identity/v3/users/dbaf8d97902f462f8860b4818e8aaeef => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:31.057160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:31.057160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:31.057160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:31.089428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:31.091071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:31.240300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1035/2043] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:31.288268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:31.289839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:31.504258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dc61a-6813-403d-9182-fb504336dd94 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:31.508550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbafce-5052-4455-a973-b99f7c07774b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:31.509594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbafce-5052-4455-a973-b99f7c07774b service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:31.509909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbafce-5052-4455-a973-b99f7c07774b service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:31.510272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbafce-5052-4455-a973-b99f7c07774b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:31.535475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbafce-5052-4455-a973-b99f7c07774b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:31.537357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbafce-5052-4455-a973-b99f7c07774b service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:31.545020 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:31.547585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:31.556700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1009/2044] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:31.570049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378c725-4d04-4376-b085-de27ec47b57e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:31.581243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:31.582465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:31.582911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:31.583356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] PATH_INFO: `/v3/projects/f6e03e2647af4aaf818c667d40e98a69` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:31.586956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e03e2647af4aaf818c667d40e98a69)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:31.589155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:31.765458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e03e2647af4aaf818c667d40e98a69', 'request_id': 'req-385df56f-958e-4a8e-a697-7d41e68b98b2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.772187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e03e2647af4aaf818c667d40e98a69', 'request_id': 'req-385df56f-958e-4a8e-a697-7d41e68b98b2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.797765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e03e2647af4aaf818c667d40e98a69', 'request_id': 'req-385df56f-958e-4a8e-a697-7d41e68b98b2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.825923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] The token cache is being invalidate because project f6e03e2647af4aaf818c667d40e98a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:31.826310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.826985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-385df56f-958e-4a8e-a697-7d41e68b98b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:31.834781 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:31.835032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:31.835315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:31.847293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1036/2045] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:31 2022] DELETE /identity/v3/projects/f6e03e2647af4aaf818c667d40e98a69 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:31.864251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:31.865493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:31.879878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:32.015466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1010/2046] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:32.024974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.025519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.025971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.064868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:32.068215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:32.092190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1037/2047] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:32.097499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.119066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a25a56-997a-464f-8a12-c2f8cd7a345b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.142332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.143296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.143461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.143744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.144518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:32.144900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.156226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.191448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1011/2048] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:32.195988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.208434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf1596-b34c-42b7-8a31-55fb44438d42 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.217462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.217730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.218078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.218362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.219077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.221678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.256267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1038/2049] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:32 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:32.260158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.277184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120a13-000d-4522-9d68-e95ef3b2a389 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.428194 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.431294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.431884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.432382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.435080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.438714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.491654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1012/2050] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:32 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:32.493219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.518491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:32.531420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ae6fc-cce7-4e0c-a097-22bb9138fe05 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.541490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.543434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:32.551851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.552708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.553492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.553781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.554531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.556175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.566696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93e00-655a-4d26-b0d2-ab2d964c5417 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.583794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1039/2051] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:32.584413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.585424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.585717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.585995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] PATH_INFO: `/v3/projects/ec40f9ee57d64ea7afb71f5b206db45f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.587679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.588430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec40f9ee57d64ea7afb71f5b206db45f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.590409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.607838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be0f8-58d7-4aaa-9e30-cb2e7863381b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.620595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.621352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.621593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.621872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.626091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.629047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.660707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1040/2052] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:32.664092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec40f9ee57d64ea7afb71f5b206db45f', 'request_id': 'req-0e0cd175-4a1b-401a-8b89-8b3161b05815'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.665178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.673187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec40f9ee57d64ea7afb71f5b206db45f', 'request_id': 'req-0e0cd175-4a1b-401a-8b89-8b3161b05815'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.681214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e4a29-cc4d-4cca-b837-a6be087b31fb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.685970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec40f9ee57d64ea7afb71f5b206db45f', 'request_id': 'req-0e0cd175-4a1b-401a-8b89-8b3161b05815'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.702245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] The token cache is being invalidate because project ec40f9ee57d64ea7afb71f5b206db45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:32.702435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.706295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.708243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1013/2053] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:32 2022] DELETE /identity/v3/projects/ec40f9ee57d64ea7afb71f5b206db45f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:32.712222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:32.715149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:32.738044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:32.833772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd175-4a1b-401a-8b89-8b3161b05815 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:32.846192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.847099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.847383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.847658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] PATH_INFO: `/v3/users/3f913f5d0c504f0c805281b7bdf75122` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.850091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f913f5d0c504f0c805281b7bdf75122)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.852066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.864843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a9d51-a74f-4da5-80e8-5ba6b57a19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:32.865830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9d51-a74f-4da5-80e8-5ba6b57a19a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.866117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9d51-a74f-4da5-80e8-5ba6b57a19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.866425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9d51-a74f-4da5-80e8-5ba6b57a19a6 admin admin] PATH_INFO: `/v3/projects/7639318d9a3c4e1cac3e172aea45cd22/users/e1c30a79abfa4753b31734c754ce4aa1/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.899697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a9d51-a74f-4da5-80e8-5ba6b57a19a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7639318d9a3c4e1cac3e172aea45cd22, user_id=e1c30a79abfa4753b31734c754ce4aa1, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:32.903184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a9d51-a74f-4da5-80e8-5ba6b57a19a6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:32.939895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1041/2054] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:32 2022] PUT /identity/v3/projects/7639318d9a3c4e1cac3e172aea45cd22/users/e1c30a79abfa4753b31734c754ce4aa1/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:32.950554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:32.951336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:32.951621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:32.957735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f913f5d0c504f0c805281b7bdf75122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.978516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f913f5d0c504f0c805281b7bdf75122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.994938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f913f5d0c504f0c805281b7bdf75122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:32.996697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f913f5d0c504f0c805281b7bdf75122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.001171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] MFA Rules not processed for user `e1c30a79abfa4753b31734c754ce4aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:33.002547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:33.021198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f913f5d0c504f0c805281b7bdf75122'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.032169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1014/2055] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:32 2022] DELETE /identity/v3/users/3f913f5d0c504f0c805281b7bdf75122 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:33.131419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1042/2056] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:33.136301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:33.138123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:33.277765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35a98-8a1a-4fac-870f-67181dddbd6d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:33.287920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:33.288813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.289212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.289669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.290362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:33.293104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:33.325754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1015/2057] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:33 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:33.330178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:33.420689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:33.427779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74196ed-c201-4c9a-8416-1982da826307 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:33.531535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:33.532366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.532685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.533189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.538199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:33.539949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:33.570717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1043/2058] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:33 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:33.574600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:33.581234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:33.583373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:33.596556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287116d5-6ee0-4b1a-a978-f21906b40605 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:33.599098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba4ade-89d7-4361-8f99-b0b2fb318b9b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:33.605818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:33.606814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.607214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:33.607348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.607498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] PATH_INFO: `/v3/projects/658a7ede664b4dd38e7855a5712a1f9c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.607896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.608239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.608438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.609151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] RBAC: Authorizing `identity:delete_project(project_id=658a7ede664b4dd38e7855a5712a1f9c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:33.609253 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:33.610915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:33.611325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:33.623747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1016/2059] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:33.628030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:33.639263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197720e6-0db2-4e15-a0e3-659e9e922865 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:33.646076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:33.646937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.647352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.647833 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.648593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:33.650305 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:33.653612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:33.670809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1017/2060] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:33.672310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:33.672760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658a7ede664b4dd38e7855a5712a1f9c', 'request_id': 'req-4edef1e6-7058-408d-8f78-4f64a69d490e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.697807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9028169-6852-4960-a3e9-b05a5cfb7d36 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:33.697975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658a7ede664b4dd38e7855a5712a1f9c', 'request_id': 'req-4edef1e6-7058-408d-8f78-4f64a69d490e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.707027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658a7ede664b4dd38e7855a5712a1f9c', 'request_id': 'req-4edef1e6-7058-408d-8f78-4f64a69d490e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.732240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] The token cache is being invalidate because project 658a7ede664b4dd38e7855a5712a1f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:33.732575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.733754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4edef1e6-7058-408d-8f78-4f64a69d490e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:33.735104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1044/2061] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:33 2022] DELETE /identity/v3/projects/658a7ede664b4dd38e7855a5712a1f9c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:33.742578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3268238-655d-4af1-9441-00cfb14f05ca None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.742805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3268238-655d-4af1-9441-00cfb14f05ca None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.743106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3268238-655d-4af1-9441-00cfb14f05ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.789322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b3268238-655d-4af1-9441-00cfb14f05ca None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:33.790972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b3268238-655d-4af1-9441-00cfb14f05ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:33.807082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b3ada-b60e-449f-b234-8d83fae621d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:33.808240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ada-b60e-449f-b234-8d83fae621d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.808672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ada-b60e-449f-b234-8d83fae621d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.809184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b3ada-b60e-449f-b234-8d83fae621d2 admin admin] PATH_INFO: `/v3/projects/1901757a01074f68bcc440f5ca6bb7d5/users/e648e79b7f3f4695ac44a8e6e794ca08/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.826703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3ada-b60e-449f-b234-8d83fae621d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1901757a01074f68bcc440f5ca6bb7d5, user_id=e648e79b7f3f4695ac44a8e6e794ca08, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:33.829962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b3ada-b60e-449f-b234-8d83fae621d2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:33.853399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1018/2062] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:33 2022] PUT /identity/v3/projects/1901757a01074f68bcc440f5ca6bb7d5/users/e648e79b7f3f4695ac44a8e6e794ca08/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:33.864325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.864735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.864958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.916977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] MFA Rules not processed for user `e648e79b7f3f4695ac44a8e6e794ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:33.918204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1045/2063] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:33.926698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:33.926895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:33.927352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:33.927753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:33.954905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:33.956275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:33.972295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:34.057056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1019/2064] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:34.062344 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.064264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:34.123239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1046/2065] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:34.128212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.143452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08b6b7-da6f-45e5-9410-e8f3d729431c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.148655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.149450 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.149801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.150154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.151204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:34.151846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.154507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.172053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811b044-d2e0-4d89-8a6c-49b2be418058 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.176965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1047/2066] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:34.180112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.180290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.180882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.181203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.181491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.182237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.184888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.193025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114211b-5257-4e1d-a1d4-f1a52bf91202 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.198294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.198977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.199259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.199543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.200230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.201474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:34.202213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.220980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1020/2067] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:34 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:34.222811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.238796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1048/2068] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:34 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:34.244010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.319684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0910-c49b-47d7-ab84-1e7f6d4d7eca admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.320048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f045ae-e9a9-4f6a-bc19-2dfd6fa441bd admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.323054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.323340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.323734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.324128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.324219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.324312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.324404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.324624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.325050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.325357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.327311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.327440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.354017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1049/2069] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:34 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:34.362482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.362699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1021/2070] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:34 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:34.363760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.374878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099ab7e-d1d2-4da3-94bc-6ab186f38777 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.375407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549a998-35c1-457b-ba3c-eeb4cab6eeb1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.381505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.382505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.382956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.383306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.383421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.387127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.387216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.387216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.387216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.387216 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.388431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.390492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.404952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1022/2071] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:34.405126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1050/2072] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:34.409087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.409442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.421619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b02d3-947f-436b-b1f6-c7c21ea0fc6e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.424392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c14c11-3cb9-4d0f-b645-0d19249404b6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.427459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.428248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.428505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.428823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.429774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.430626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.431418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.431723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.432076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.432423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] PATH_INFO: `/v3/projects/6f06d306622f4c8886adcf0b041f3008/users/8ee96ddadd4746b1b981138fad9ebe72/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.444249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1051/2073] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:34.448522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.451826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f06d306622f4c8886adcf0b041f3008, user_id=8ee96ddadd4746b1b981138fad9ebe72, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.455314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.462270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8cfa-27eb-4120-920d-f8bfa033fd49 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.471716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1023/2074] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:34 2022] PUT /identity/v3/projects/6f06d306622f4c8886adcf0b041f3008/users/8ee96ddadd4746b1b981138fad9ebe72/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:34.475446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.475587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ff2ed-4159-4ffb-984a-739bb0ad71cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.476602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff2ed-4159-4ffb-984a-739bb0ad71cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.476921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff2ed-4159-4ffb-984a-739bb0ad71cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.477203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff2ed-4159-4ffb-984a-739bb0ad71cf admin admin] PATH_INFO: `/v3/projects/3429e99ac2a94266b152e053bc6a0006/users/7a4b471d14044069a5969e8bc6ca4f2d/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.503446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ff2ed-4159-4ffb-984a-739bb0ad71cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3429e99ac2a94266b152e053bc6a0006, user_id=7a4b471d14044069a5969e8bc6ca4f2d, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.506220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ff2ed-4159-4ffb-984a-739bb0ad71cf admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.524550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1052/2075] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:34 2022] PUT /identity/v3/projects/3429e99ac2a94266b152e053bc6a0006/users/7a4b471d14044069a5969e8bc6ca4f2d/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:34.532697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.532697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.532697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.552363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96ffe5-4253-4827-ad59-71f7fcd9b12a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.552829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:34.554130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:34.575843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:34.616230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:34.627623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.628335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1053/2076] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:34.629143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.629692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.630218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.631251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.633365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.639534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.641449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:34.654660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1024/2077] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:34.655675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.667819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be4c8d-baef-44ba-ab84-1977786a52cb admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.672981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a26e70-074d-4f82-91d3-3dc4179382b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.674409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26e70-074d-4f82-91d3-3dc4179382b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.674701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26e70-074d-4f82-91d3-3dc4179382b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.674989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a26e70-074d-4f82-91d3-3dc4179382b5 admin admin] PATH_INFO: `/v3/projects/6f06d306622f4c8886adcf0b041f3008/users/8ee96ddadd4746b1b981138fad9ebe72/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.679543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a26e70-074d-4f82-91d3-3dc4179382b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f06d306622f4c8886adcf0b041f3008, user_id=8ee96ddadd4746b1b981138fad9ebe72, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.682293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a26e70-074d-4f82-91d3-3dc4179382b5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.695473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1025/2078] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:34 2022] PUT /identity/v3/projects/6f06d306622f4c8886adcf0b041f3008/users/8ee96ddadd4746b1b981138fad9ebe72/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:34.706581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.706873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.707158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.718360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62223d56-51a1-45d5-a176-6727975dccd8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.739985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] MFA Rules not processed for user `8ee96ddadd4746b1b981138fad9ebe72`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:34.741808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:34.779387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.780058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.780350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.780635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.818381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1026/2079] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:34.828907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:34.830505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:34.847138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.848763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.858753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1054/2080] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:34.895433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de302a5-1595-4c31-9130-d197053382e7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:34.899157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:34.899816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:34.900097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:34.900378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:34.911293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:34.912790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:34.924199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1027/2081] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:35.516854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:35.530036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fb329-10e6-4e0f-a631-dc71c032ca79 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:35.537009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:35.537753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:35.538224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:35.538989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:35.541639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:35.577500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:35.625571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:35.628559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de5f5b-145d-433f-8e51-b79806bd5dad service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:35.645864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1055/2082] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:40.153870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:40.156300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:40.171953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee552c0-64c0-42ec-aa59-ad48f3742cf1 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:40.176240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cc217-55e3-4b00-9e61-059fe3748e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:40.176914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc217-55e3-4b00-9e61-059fe3748e44 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:40.177245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc217-55e3-4b00-9e61-059fe3748e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:40.177553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc217-55e3-4b00-9e61-059fe3748e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:40.280191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cc217-55e3-4b00-9e61-059fe3748e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:40.281839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65cc217-55e3-4b00-9e61-059fe3748e44 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:40.309735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1028/2083] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:42.359477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd360f-5e40-4ed8-9c7f-30fd5299d4b3 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:42.360040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd360f-5e40-4ed8-9c7f-30fd5299d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:42.360040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd360f-5e40-4ed8-9c7f-30fd5299d4b3 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:42.362022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1056/2084] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:55:42.379586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c712c-421c-4b61-814b-b2dc80f9505b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:42.380123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c712c-421c-4b61-814b-b2dc80f9505b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:42.381165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c712c-421c-4b61-814b-b2dc80f9505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:42.397570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:42.406445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-eb6c712c-421c-4b61-814b-b2dc80f9505b None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:42.410686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-eb6c712c-421c-4b61-814b-b2dc80f9505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:42.511171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd360f-5e40-4ed8-9c7f-30fd5299d4b3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:42.513813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f2cd360f-5e40-4ed8-9c7f-30fd5299d4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:42.524867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1029/2085] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:42.528320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:42.528734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:42.529121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:42.534343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd360f-5e40-4ed8-9c7f-30fd5299d4b3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:42.541344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:42.542237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:42.542511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:42.542791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] PATH_INFO: `/v3/users/5063db22225a4d0b97ec5dcac8770045` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:42.544878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5063db22225a4d0b97ec5dcac8770045)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:42.548806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:42.566529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] MFA Rules not processed for user `7a4b471d14044069a5969e8bc6ca4f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:42.568559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:42.614809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5063db22225a4d0b97ec5dcac8770045'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:42.638403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5063db22225a4d0b97ec5dcac8770045'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:42.652989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5063db22225a4d0b97ec5dcac8770045'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:42.654268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5063db22225a4d0b97ec5dcac8770045'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:42.675628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5063db22225a4d0b97ec5dcac8770045'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:42.695498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1057/2086] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:42 2022] DELETE /identity/v3/users/5063db22225a4d0b97ec5dcac8770045 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:42.701565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:42.702327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:42.727389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1030/2087] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:42.728770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:42.732408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:42.777079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13323811-d7cf-4778-abda-36e7b8a85d96 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:42.885308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6590431-cab3-469f-8e3b-4b71b7d21e21 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:42.892978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:42.894407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:42.894917 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:42.895346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:42.898229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:42.920807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:42.922698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:42.924829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:42.925633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:42.926905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:42.927274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:42.928595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:42.931008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:42.937690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1058/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:42.992672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1031/2089] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:42 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:42.996465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.009827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6792a9-b98d-41d5-917c-e72df3ff966b service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.054726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.055915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:43.057096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.102506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.103426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.103808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.104179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.105014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.107050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.115670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:43.134600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1059/2090] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:42 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:43.138515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.155699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90dc568-7dab-410c-be5b-81891802c4ef admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.164734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.165561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.165941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.166309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.167428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.169929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.185201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd3d0-586f-4480-bd93-a82bcf785641 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.190231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1060/2091] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:43.193284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.196792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.197886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.198492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.198619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] PATH_INFO: `/v3/projects/873a5ea6741e4762857e2bae05f5e06d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.199863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873a5ea6741e4762857e2bae05f5e06d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.201934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.205571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93e23-e6a2-49a9-9789-a995a25d4d5d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.211529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.212636 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.213115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.213398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] PATH_INFO: `/v3/projects/4bc58de9b36642a096ddde216d1f490f/users/877d90edfc1a495f80ee6cef978a077b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.233807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc58de9b36642a096ddde216d1f490f, user_id=877d90edfc1a495f80ee6cef978a077b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.237753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.256894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1061/2092] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:43 2022] PUT /identity/v3/projects/4bc58de9b36642a096ddde216d1f490f/users/877d90edfc1a495f80ee6cef978a077b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:43.260620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.271864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873a5ea6741e4762857e2bae05f5e06d', 'request_id': 'req-a79b9405-9715-46f0-99bc-56b714430a59'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.279544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873a5ea6741e4762857e2bae05f5e06d', 'request_id': 'req-a79b9405-9715-46f0-99bc-56b714430a59'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.289518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873a5ea6741e4762857e2bae05f5e06d', 'request_id': 'req-a79b9405-9715-46f0-99bc-56b714430a59'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.303964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] The token cache is being invalidate because project 873a5ea6741e4762857e2bae05f5e06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:43.304289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.304965 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-a79b9405-9715-46f0-99bc-56b714430a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.307049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1032/2093] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:43 2022] DELETE /identity/v3/projects/873a5ea6741e4762857e2bae05f5e06d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:43.312577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5439-9043-462c-b8ae-4334e58d6a53 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.312867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5439-9043-462c-b8ae-4334e58d6a53 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.313181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5439-9043-462c-b8ae-4334e58d6a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.339407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a8aa5439-9043-462c-b8ae-4334e58d6a53 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:43.340637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a8aa5439-9043-462c-b8ae-4334e58d6a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.346692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14f82e-7be0-42d4-a252-a38da9f4cad3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.427054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1033/2094] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:43.427592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.427592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.427592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.427592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.428262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.430287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.430653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.430790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.431035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.448191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1062/2095] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:43.455850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.456044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:43.456142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.456244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.467252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1034/2096] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:43.468481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.468606 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ba33c-febc-4e8d-a0c5-b0d7455b6c4a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.476340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.477577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.477868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.478155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] PATH_INFO: `/v3/projects/4bc58de9b36642a096ddde216d1f490f/users/877d90edfc1a495f80ee6cef978a077b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.480004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bffe9-284e-4446-8eb8-02eb50b06c29 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.480619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc58de9b36642a096ddde216d1f490f, user_id=877d90edfc1a495f80ee6cef978a077b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.486532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.488397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.489508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.490131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.490501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.491564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:43.492122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.494376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.503011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1063/2097] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:43 2022] PUT /identity/v3/projects/4bc58de9b36642a096ddde216d1f490f/users/877d90edfc1a495f80ee6cef978a077b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:43.513357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1035/2098] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:43.518400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.521820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.535482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.536732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:43.556282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19a819-a1d1-460c-bce3-3b2499392ed0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.603671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:43.620369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706ec6-5a65-4140-9706-d783ab70678b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.630266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.630913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.631203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.631482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.632196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.635098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.676177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1064/2099] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:43 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:43.682245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.683696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.684012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.684447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] PATH_INFO: `/v3/users/e1c30a79abfa4753b31734c754ce4aa1` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.686421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c30a79abfa4753b31734c754ce4aa1)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.687831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.688959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.770842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c30a79abfa4753b31734c754ce4aa1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.793034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c30a79abfa4753b31734c754ce4aa1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.804798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c30a79abfa4753b31734c754ce4aa1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.805748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c30a79abfa4753b31734c754ce4aa1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.819976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2751884f-a331-492a-8167-53e8d8613a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c30a79abfa4753b31734c754ce4aa1'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.833275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1036/2100] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:43 2022] DELETE /identity/v3/users/e1c30a79abfa4753b31734c754ce4aa1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:43.838557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.838859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.839186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.863451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd277-67f4-46cb-8394-4c726a48a6b7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.882040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:43.887002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.040880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.041616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.042261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.042261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.042835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.045114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.063908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1037/2101] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:44.082484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.084351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.133894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1065/2102] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:43 2022] POST /identity/v3/users => generated 292 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:44.135811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.140520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.162378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487d764-e568-4d52-93e8-7dd40b338b36 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.175946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.176778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.177118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.177401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.178475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.183242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.212572 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1066/2103] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:44.215384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.235850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc8bd2-af53-41c7-b5a2-7a5c1fd82979 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.255096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:44.257451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.258885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.259475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.259769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.260515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.263110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.264829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca80bb-6526-441c-938e-01651efe02b9 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.283121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1067/2104] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:44.283339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a021b83-b741-4c1d-99a2-de3496466b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.283339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a021b83-b741-4c1d-99a2-de3496466b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.283339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a021b83-b741-4c1d-99a2-de3496466b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.283339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a021b83-b741-4c1d-99a2-de3496466b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.286733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.305728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715f016-5e60-496a-876e-a4b8171d0339 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.313121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a021b83-b741-4c1d-99a2-de3496466b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.314881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.315338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a021b83-b741-4c1d-99a2-de3496466b0f service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.316079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.316414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.316701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] PATH_INFO: `/v3/projects/ae78f51999f343d8b3b9f57c6dab7c4b/users/818eb3d56b1b45879085c5657c4d8a1f/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.336788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:44.339348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1038/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:44.346403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae78f51999f343d8b3b9f57c6dab7c4b, user_id=818eb3d56b1b45879085c5657c4d8a1f, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.351146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.381028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1068/2106] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:44 2022] PUT /identity/v3/projects/ae78f51999f343d8b3b9f57c6dab7c4b/users/818eb3d56b1b45879085c5657c4d8a1f/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:44.383484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.383744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.394116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.434093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] MFA Rules not processed for user `818eb3d56b1b45879085c5657c4d8a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:44.437109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.551200 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1039/2107] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:44.552404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.627863 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507fea3-c35c-439d-bd6e-2373f3df08dc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.636391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.637119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.637408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.638838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.641033 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.643600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.682896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.690820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1069/2108] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:44.715218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e580d9-fe75-4692-a599-f36e7a94f640 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.897365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.898228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.898516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.898910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.899616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.906967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.945657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.948916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.969223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935f1f2-ecbc-4ba5-b670-364b8fb42818 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.977580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1040/2109] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/users => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:44.978499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.989405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.990268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.990551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.990823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] PATH_INFO: `/v3/projects/7639318d9a3c4e1cac3e172aea45cd22` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.993121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7639318d9a3c4e1cac3e172aea45cd22)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.995066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.999703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738db73a-dff6-4597-81c0-770b1ce74df6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.015302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.015988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.016274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.017133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.017916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.019855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.040195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1041/2110] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:45.044879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.069263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e0ea-e3d6-4f20-95aa-8b8ed524fbe3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.085270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.086351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.086510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.086712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] PATH_INFO: `/v3/projects/894b10f800c0448ebbb547738e067eb6/users/b28561dc29ad4265a8b63197482bd7ca/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.105296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7639318d9a3c4e1cac3e172aea45cd22', 'request_id': 'req-b42be21e-f69a-41e1-8bd6-c2463a4b5646'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.117159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7639318d9a3c4e1cac3e172aea45cd22', 'request_id': 'req-b42be21e-f69a-41e1-8bd6-c2463a4b5646'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.126079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7639318d9a3c4e1cac3e172aea45cd22', 'request_id': 'req-b42be21e-f69a-41e1-8bd6-c2463a4b5646'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.129400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=894b10f800c0448ebbb547738e067eb6, user_id=b28561dc29ad4265a8b63197482bd7ca, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.133652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.149749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] The token cache is being invalidate because project 7639318d9a3c4e1cac3e172aea45cd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:45.150484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.151951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.155880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1070/2111] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:44 2022] DELETE /identity/v3/projects/7639318d9a3c4e1cac3e172aea45cd22 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:45.161209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.163593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.174988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1042/2112] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:45 2022] PUT /identity/v3/projects/894b10f800c0448ebbb547738e067eb6/users/b28561dc29ad4265a8b63197482bd7ca/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:45.182385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.187779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.279638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:45.309091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:45.317075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be21e-f69a-41e1-8bd6-c2463a4b5646 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.324441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.325927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.326485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.327624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] PATH_INFO: `/v3/users/e648e79b7f3f4695ac44a8e6e794ca08` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.329888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e648e79b7f3f4695ac44a8e6e794ca08)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.330765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7350125-70a1-4e9a-8782-275be43fb3ad admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.332717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.341459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.342230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.342575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.342949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.343698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.345764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.362737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1043/2113] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:45.363830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.385197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1e5aa-abe6-44a5-a42a-271fdbae30f5 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.398419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2dd6a-39ab-47e0-9cb8-cdc7f575bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.399595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2dd6a-39ab-47e0-9cb8-cdc7f575bcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.399945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2dd6a-39ab-47e0-9cb8-cdc7f575bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.400651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2dd6a-39ab-47e0-9cb8-cdc7f575bcbc admin admin] PATH_INFO: `/v3/projects/894b10f800c0448ebbb547738e067eb6/users/b28561dc29ad4265a8b63197482bd7ca/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.403438 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2dd6a-39ab-47e0-9cb8-cdc7f575bcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=894b10f800c0448ebbb547738e067eb6, user_id=b28561dc29ad4265a8b63197482bd7ca, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.406387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2dd6a-39ab-47e0-9cb8-cdc7f575bcbc admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.415098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e648e79b7f3f4695ac44a8e6e794ca08'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.428207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1044/2114] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:45 2022] PUT /identity/v3/projects/894b10f800c0448ebbb547738e067eb6/users/b28561dc29ad4265a8b63197482bd7ca/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:45.440539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.441202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.441202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.444319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e648e79b7f3f4695ac44a8e6e794ca08'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.455097 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e648e79b7f3f4695ac44a8e6e794ca08'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.456395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e648e79b7f3f4695ac44a8e6e794ca08'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.466322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e648e79b7f3f4695ac44a8e6e794ca08'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.479190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1071/2115] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:45 2022] DELETE /identity/v3/users/e648e79b7f3f4695ac44a8e6e794ca08 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:45.489421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] MFA Rules not processed for user `b28561dc29ad4265a8b63197482bd7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:45.490663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.602065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1045/2116] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:45.616678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.618872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.774727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3d428-bc78-4b3f-92ee-668ebb35c486 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.779673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.781095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.781679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.782910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.795866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.799074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.820665 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1072/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:45.907394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.916413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.918409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.921063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1485-9e4e-40af-8ef5-722d367ba8f3 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.926184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.926927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.927331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.927682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.930338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:46.060706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe9920-43b2-4b89-a84b-bc0f396245ec service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.072948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.073773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.074045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.074323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] PATH_INFO: `/v3/projects/1901757a01074f68bcc440f5ca6bb7d5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.077180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1901757a01074f68bcc440f5ca6bb7d5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.082881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.084463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.085827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.099265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1046/2118] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:55:46.119343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:46.162210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1901757a01074f68bcc440f5ca6bb7d5', 'request_id': 'req-4cc2f8fd-b59b-4551-bade-bcb6857014f9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.169476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1901757a01074f68bcc440f5ca6bb7d5', 'request_id': 'req-4cc2f8fd-b59b-4551-bade-bcb6857014f9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.178898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1901757a01074f68bcc440f5ca6bb7d5', 'request_id': 'req-4cc2f8fd-b59b-4551-bade-bcb6857014f9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.201950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] The token cache is being invalidate because project 1901757a01074f68bcc440f5ca6bb7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:46.202244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.203702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.206486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1073/2119] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:45 2022] DELETE /identity/v3/projects/1901757a01074f68bcc440f5ca6bb7d5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:46.210540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.232204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1fcf-b00b-48a2-bd57-c7fc20fc04e9 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.327180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:46.355464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.356615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.356992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.357333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] PATH_INFO: `/v3/users/8ee96ddadd4746b1b981138fad9ebe72` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.359139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee96ddadd4746b1b981138fad9ebe72)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.362074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.463446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee96ddadd4746b1b981138fad9ebe72'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.497117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee96ddadd4746b1b981138fad9ebe72'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.509628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee96ddadd4746b1b981138fad9ebe72'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.511195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee96ddadd4746b1b981138fad9ebe72'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.525484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-13dea91f-06eb-430d-82de-cb1c976c2361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee96ddadd4746b1b981138fad9ebe72'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.543892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1047/2120] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:46 2022] DELETE /identity/v3/users/8ee96ddadd4746b1b981138fad9ebe72 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:46.602315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.606939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:46.648303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f8fd-b59b-4551-bade-bcb6857014f9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.813692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.819675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.820641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.821143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] PATH_INFO: `/v3/users/818eb3d56b1b45879085c5657c4d8a1f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.823921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=818eb3d56b1b45879085c5657c4d8a1f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.826655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.926296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818eb3d56b1b45879085c5657c4d8a1f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.942678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818eb3d56b1b45879085c5657c4d8a1f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.950546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818eb3d56b1b45879085c5657c4d8a1f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.951378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818eb3d56b1b45879085c5657c4d8a1f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.961183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818eb3d56b1b45879085c5657c4d8a1f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:46.968665 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1074/2121] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:46 2022] DELETE /identity/v3/users/818eb3d56b1b45879085c5657c4d8a1f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:46.974441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.974732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.975094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.995429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:46.996897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.106115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1048/2122] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:47.117342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.120052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.184911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:47.216186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8b653-fb98-4001-802c-d00a9f60ae49 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.221231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197a8c-6f05-41a8-9143-63b585da1b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.222873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197a8c-6f05-41a8-9143-63b585da1b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.223391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197a8c-6f05-41a8-9143-63b585da1b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.223771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197a8c-6f05-41a8-9143-63b585da1b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.236977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197a8c-6f05-41a8-9143-63b585da1b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.237739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197a8c-6f05-41a8-9143-63b585da1b3f service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.250330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1075/2123] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:47.391929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.394758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.429834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f9f03-be93-4c60-aa2f-7668fae225e4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.452552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.453723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.454288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.455159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] PATH_INFO: `/v3/projects/6f06d306622f4c8886adcf0b041f3008` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.457698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f06d306622f4c8886adcf0b041f3008)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.459726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.564899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f06d306622f4c8886adcf0b041f3008', 'request_id': 'req-e14c158a-a401-4225-a875-0356e22b5430'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.570044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:47.571380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f06d306622f4c8886adcf0b041f3008', 'request_id': 'req-e14c158a-a401-4225-a875-0356e22b5430'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.583906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f06d306622f4c8886adcf0b041f3008', 'request_id': 'req-e14c158a-a401-4225-a875-0356e22b5430'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.609838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] The token cache is being invalidate because project 6f06d306622f4c8886adcf0b041f3008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:47.611372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.613726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e14c158a-a401-4225-a875-0356e22b5430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.619917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1049/2124] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:47 2022] DELETE /identity/v3/projects/6f06d306622f4c8886adcf0b041f3008 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:47.627123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.628047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.628513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.664516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:47.666481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.745292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1076/2125] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:47.754176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.754901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.755376 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.783228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:47.785522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.799322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1050/2126] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:47.803980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.818884 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb0895-463f-41ca-9eec-5a1c2bae6c4e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.820480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.822621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.836319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.836980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.837250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.838812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.838812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:47.840526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.844072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.850455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e201-2b17-401d-8694-fd5bb5e4d9e0 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.856086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.857065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.857345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.857615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] PATH_INFO: `/v3/projects/ae78f51999f343d8b3b9f57c6dab7c4b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.858853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae78f51999f343d8b3b9f57c6dab7c4b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.862105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.864410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1077/2127] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:47.871772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.891766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d70e4-97ea-46c0-8af0-7d7b3e6534b9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.897278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.898211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.898458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.898752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.899681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.901750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.928304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae78f51999f343d8b3b9f57c6dab7c4b', 'request_id': 'req-decd8909-0e9d-4649-9f4b-77f5e406fae3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.938721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae78f51999f343d8b3b9f57c6dab7c4b', 'request_id': 'req-decd8909-0e9d-4649-9f4b-77f5e406fae3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.950202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1078/2128] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:47 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:47.951235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.957128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae78f51999f343d8b3b9f57c6dab7c4b', 'request_id': 'req-decd8909-0e9d-4649-9f4b-77f5e406fae3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.977380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] The token cache is being invalidate because project ae78f51999f343d8b3b9f57c6dab7c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:47.977700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.978528 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:47.980871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1051/2129] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:47 2022] DELETE /identity/v3/projects/ae78f51999f343d8b3b9f57c6dab7c4b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:47.985484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.987764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:48.067806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1028-39da-4d4e-a1fb-b53fc0f7d570 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.074196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:48.075551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.075859 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.076347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.077291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:48.079372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:48.082417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd8909-0e9d-4649-9f4b-77f5e406fae3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.089890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:48.091560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.091853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.093137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] PATH_INFO: `/v3/users/b28561dc29ad4265a8b63197482bd7ca` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.096790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28561dc29ad4265a8b63197482bd7ca)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:48.099634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:48.119630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1079/2130] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:47 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:48.120920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:48.123308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:48.139586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfc84-1b34-4440-8420-7845559d050d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.148107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:48.149261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.149699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.150902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.152339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:48.154797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:48.173759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1080/2131] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:48.177939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:48.190414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07a3cd-6e4a-4f32-bf4d-5caeb61c56d9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.196519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:48.197119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.197677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.197677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.198424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:48.200996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:48.217959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1081/2132] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:48.219285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:48.226137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:48.230156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fc1c6-637f-449f-a9c8-4e6b404c85ac admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.234101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28561dc29ad4265a8b63197482bd7ca'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:48.246309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:48.247329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.249247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.249612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] PATH_INFO: `/v3/projects/f9e637c20f6f4900bb3ab066e4f3f14d/users/3faee77846f74980b0524c8a0840d4b9/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.263222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:48.267798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28561dc29ad4265a8b63197482bd7ca'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:48.283459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28561dc29ad4265a8b63197482bd7ca'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:48.285364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28561dc29ad4265a8b63197482bd7ca'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:48.289737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e637c20f6f4900bb3ab066e4f3f14d, user_id=3faee77846f74980b0524c8a0840d4b9, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:48.294072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:48.310047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-0d1766eb-b277-448b-9b56-658825586301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28561dc29ad4265a8b63197482bd7ca'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:48.334560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1052/2133] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:47 2022] DELETE /identity/v3/users/b28561dc29ad4265a8b63197482bd7ca => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:48.349280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1082/2134] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:48 2022] PUT /identity/v3/projects/f9e637c20f6f4900bb3ab066e4f3f14d/users/3faee77846f74980b0524c8a0840d4b9/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:48.362989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.363290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.363571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.436254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] MFA Rules not processed for user `3faee77846f74980b0524c8a0840d4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:48.437892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:48.581156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1053/2135] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:48.585503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:48.587424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:48.702772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba45386-3b06-4ce1-9116-8f07432e7bb0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.812834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:48.813972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:48.814626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:48.815418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:48.816441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:48.818777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:48.857312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1083/2136] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:48 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:48.862159 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:48.881338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89e6c-d575-47ca-8f14-b6a143093ed4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:48.946817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:48.949269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:49.001294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.002000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.002285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.002675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.003595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.018367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.062285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1054/2137] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:48 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:49.062734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11756c3-bf24-4c31-ae12-638c2961ec21 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.067669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.071534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.072286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.072612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.072900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] PATH_INFO: `/v3/projects/894b10f800c0448ebbb547738e067eb6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.074241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=894b10f800c0448ebbb547738e067eb6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.076399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.097945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb1946-44d8-4330-a44d-03fa3b3e5220 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.102343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:49.109302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.112226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.112595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.113791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.116280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.118625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.141908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1055/2138] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:49.149213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.158719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894b10f800c0448ebbb547738e067eb6', 'request_id': 'req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:49.167712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894b10f800c0448ebbb547738e067eb6', 'request_id': 'req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:49.172605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91b0d-5112-45f5-84a3-cee1c858e8e1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.179515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894b10f800c0448ebbb547738e067eb6', 'request_id': 'req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:49.203071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] The token cache is being invalidate because project 894b10f800c0448ebbb547738e067eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:49.203353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:49.205841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-15a5a7da-b8eb-4ab0-a8ad-b24daec44aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:49.207891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1084/2139] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:48 2022] DELETE /identity/v3/projects/894b10f800c0448ebbb547738e067eb6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:49.213286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff12e-8cf9-48d0-9399-a1c03b23eb67 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.213565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff12e-8cf9-48d0-9399-a1c03b23eb67 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.213853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff12e-8cf9-48d0-9399-a1c03b23eb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.245862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c50ff12e-8cf9-48d0-9399-a1c03b23eb67 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:49.246930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:49.249845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c50ff12e-8cf9-48d0-9399-a1c03b23eb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:49.267398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.268786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.270002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.270282 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] PATH_INFO: `/v3/projects/909451b84f34474eb4a5f8542e8a4ae2/users/82f571250ce14e6ba0ddbc82b2050740/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.297927 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=909451b84f34474eb4a5f8542e8a4ae2, user_id=82f571250ce14e6ba0ddbc82b2050740, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.301387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.324478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1056/2140] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:49 2022] PUT /identity/v3/projects/909451b84f34474eb4a5f8542e8a4ae2/users/82f571250ce14e6ba0ddbc82b2050740/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:49.328285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.332874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:49.364539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1085/2141] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:49.376747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.377254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.377654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.410637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:49.411998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:49.435352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e96f-2f00-4ab5-b39f-a80984da8a5b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.442314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.443072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.443359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.443640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.444434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.446203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.457740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1057/2142] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:49.461702 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.471958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b6f1a-1327-4541-998c-42e9e138b99a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.477506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf34e00-ca76-4dcb-ba1d-400919cc7db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.478487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf34e00-ca76-4dcb-ba1d-400919cc7db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.478773 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf34e00-ca76-4dcb-ba1d-400919cc7db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.479051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf34e00-ca76-4dcb-ba1d-400919cc7db3 admin admin] PATH_INFO: `/v3/projects/909451b84f34474eb4a5f8542e8a4ae2/users/82f571250ce14e6ba0ddbc82b2050740/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.481235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf34e00-ca76-4dcb-ba1d-400919cc7db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909451b84f34474eb4a5f8542e8a4ae2, user_id=82f571250ce14e6ba0ddbc82b2050740, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.484207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf34e00-ca76-4dcb-ba1d-400919cc7db3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.504598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1058/2143] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:49 2022] PUT /identity/v3/projects/909451b84f34474eb4a5f8542e8a4ae2/users/82f571250ce14e6ba0ddbc82b2050740/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:49.514979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.516956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.520570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.524984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1086/2144] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:49.527843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.547348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e0ae8-728f-4877-b137-c30da22c4576 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.563544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] MFA Rules not processed for user `82f571250ce14e6ba0ddbc82b2050740`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:49.566056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:49.617767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:49.638260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.638960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.639245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.639524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.640312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:49.640623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.644352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.683129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1059/2145] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:49.683738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1087/2146] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:49.690146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.694761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.696772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:49.712045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0491a96-af8a-4916-bf0b-baf2a432640f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.720849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.722079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.722286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.722991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.725101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.768230 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1088/2147] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:49 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:49.772871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.784401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:49.805753 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199769-dd99-44f4-b5e8-87cbe296574d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.895525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.896445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.896734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.897063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.912988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5775539-4402-4508-943c-d0c4c2b97198 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.920810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.921810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.922294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.922810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.923686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.927339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.959032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1089/2148] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:49 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:49.963447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:49.982128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3351c-2743-4f05-94c2-618de8a12409 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:49.990491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:49.991523 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:49.991811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:49.992078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:49.992874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.994165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:49.995390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:49.999531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.019562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1090/2149] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:50.024565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.034017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1060/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:50.066655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046560-3847-42cb-80fa-f4f405b6c115 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.088548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a320df7-b494-46c2-ad28-c06b313a0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.089301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320df7-b494-46c2-ad28-c06b313a0c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.089588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320df7-b494-46c2-ad28-c06b313a0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.090208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320df7-b494-46c2-ad28-c06b313a0c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.121719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a320df7-b494-46c2-ad28-c06b313a0c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.123378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a320df7-b494-46c2-ad28-c06b313a0c67 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.136670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1091/2151] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:50.141514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.172315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4342c7-3013-4ec9-b8fd-bf8031a6376c service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.179268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a522c-b7fe-457b-8f62-d8e922a07893 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.179612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a522c-b7fe-457b-8f62-d8e922a07893 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.179831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a522c-b7fe-457b-8f62-d8e922a07893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.182219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.183986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.183986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.183986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] PATH_INFO: `/v3/projects/cb730baf947a4ae1a99ed282f82fa6de/users/4ad6d99bd8f4476789a454dd46eb5ffb/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.202791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb730baf947a4ae1a99ed282f82fa6de, user_id=4ad6d99bd8f4476789a454dd46eb5ffb, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.207053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.215871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-2f5a522c-b7fe-457b-8f62-d8e922a07893 None None] MFA Rules not processed for user `877d90edfc1a495f80ee6cef978a077b`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:50.217101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-2f5a522c-b7fe-457b-8f62-d8e922a07893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.226612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1061/2152] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:50 2022] PUT /identity/v3/projects/cb730baf947a4ae1a99ed282f82fa6de/users/4ad6d99bd8f4476789a454dd46eb5ffb/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:50.236415 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.293349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1092/2153] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:50.295085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.295377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.296077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.299633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a25a5e-6eee-45c4-ab2d-f2f2d1669597 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.309744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.310421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.310742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.310993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.315187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.321111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:50.336716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] MFA Rules not processed for user `4ad6d99bd8f4476789a454dd46eb5ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:50.338000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.359704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:50.400283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.402536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.415086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1062/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:50.427325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.429818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.462032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1093/2155] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:50.473905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.477865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.504880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded437-bc9b-4bbb-b729-8f2c5775d654 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.509607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e5fbc-9944-4ce6-b004-1348ef76b6b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.510273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e5fbc-9944-4ce6-b004-1348ef76b6b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.510556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e5fbc-9944-4ce6-b004-1348ef76b6b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.512247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e5fbc-9944-4ce6-b004-1348ef76b6b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.522991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e5fbc-9944-4ce6-b004-1348ef76b6b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.524564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e5fbc-9944-4ce6-b004-1348ef76b6b2 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.537289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1094/2156] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:50.581964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26780eab-e9ef-40be-a016-c493bd5a3a43 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.591564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.592295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.592582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.593285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.596308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.697975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.699866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.722526 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1063/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:51.932731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4fa53-2f3a-48c9-8acf-b122142135ed None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:51.933258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4fa53-2f3a-48c9-8acf-b122142135ed None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:51.933338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4fa53-2f3a-48c9-8acf-b122142135ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:51.957867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9cc4fa53-2f3a-48c9-8acf-b122142135ed None None] MFA Rules not processed for user `7a4b471d14044069a5969e8bc6ca4f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:51.959083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9cc4fa53-2f3a-48c9-8acf-b122142135ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:51.966785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1095/2158] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:57.558774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:57.630117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6198c7-aa1c-463e-ad6d-53226aada413 service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:57.635011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:57.635844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.636121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.636395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] PATH_INFO: `/v3/users/3faee77846f74980b0524c8a0840d4b9` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.637590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3faee77846f74980b0524c8a0840d4b9)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:57.639523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:57.655762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:57.691120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3faee77846f74980b0524c8a0840d4b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.702789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3faee77846f74980b0524c8a0840d4b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.710082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3faee77846f74980b0524c8a0840d4b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.710760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3faee77846f74980b0524c8a0840d4b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.722269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3faee77846f74980b0524c8a0840d4b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.729201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1064/2159] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:57 2022] DELETE /identity/v3/users/3faee77846f74980b0524c8a0840d4b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:57.734261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.734881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.735117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.761222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:57.761222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:57.857879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1096/2160] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:57.868613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:57.870128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:57.929122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f68-4476-47e2-98ec-4c14f330569e admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:57.932769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4327555-400b-4b59-9fe7-5e8bdef478af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:57.933474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327555-400b-4b59-9fe7-5e8bdef478af service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.933756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327555-400b-4b59-9fe7-5e8bdef478af service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.934028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4327555-400b-4b59-9fe7-5e8bdef478af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.943787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4327555-400b-4b59-9fe7-5e8bdef478af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:57.945274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4327555-400b-4b59-9fe7-5e8bdef478af service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:57.955644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1065/2161] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:58.083217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.084791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.098117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900059c-27ca-4361-9372-1e6da72451c7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.104146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.104960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.105237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.105579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] PATH_INFO: `/v3/users/4ad6d99bd8f4476789a454dd46eb5ffb` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.106720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad6d99bd8f4476789a454dd46eb5ffb)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.108657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.159360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad6d99bd8f4476789a454dd46eb5ffb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.172773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad6d99bd8f4476789a454dd46eb5ffb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.180317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad6d99bd8f4476789a454dd46eb5ffb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.181132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad6d99bd8f4476789a454dd46eb5ffb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.183182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:58.191563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad6d99bd8f4476789a454dd46eb5ffb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.198726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1097/2162] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:58 2022] DELETE /identity/v3/users/4ad6d99bd8f4476789a454dd46eb5ffb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:58.204432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.204739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.205054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.223040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:58.224276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.260315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.262107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.305016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1066/2163] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:58.314949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.316442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.362117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906c76a-a6d3-458b-8268-f57ff6a0c836 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.365664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:58.367749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.368695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.369145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.369403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] PATH_INFO: `/v3/projects/f9e637c20f6f4900bb3ab066e4f3f14d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.371141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e637c20f6f4900bb3ab066e4f3f14d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.373346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.391818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ffaff-1c6e-40e9-9143-89936570f2c8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.396382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.397068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.397357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.397624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.408515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.410005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.421090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1067/2164] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:55:58.443609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e637c20f6f4900bb3ab066e4f3f14d', 'request_id': 'req-8e73ad62-6e14-4add-8a9e-d009786f14c2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.454891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e637c20f6f4900bb3ab066e4f3f14d', 'request_id': 'req-8e73ad62-6e14-4add-8a9e-d009786f14c2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.461399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e637c20f6f4900bb3ab066e4f3f14d', 'request_id': 'req-8e73ad62-6e14-4add-8a9e-d009786f14c2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.480383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] The token cache is being invalidate because project f9e637c20f6f4900bb3ab066e4f3f14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:58.480679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.481931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.483916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1098/2165] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:58 2022] DELETE /identity/v3/projects/f9e637c20f6f4900bb3ab066e4f3f14d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:58.489693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.501411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121813e5-6c3f-4371-84df-06f95571a418 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.596757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.597800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.598067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.598342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] PATH_INFO: `/v3/users/82f571250ce14e6ba0ddbc82b2050740` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.599553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f571250ce14e6ba0ddbc82b2050740)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.602075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.667223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f571250ce14e6ba0ddbc82b2050740'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.686100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f571250ce14e6ba0ddbc82b2050740'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.703360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f571250ce14e6ba0ddbc82b2050740'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.705851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f571250ce14e6ba0ddbc82b2050740'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.728643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-450d15f4-f8b0-42fa-8e31-9ee32213f482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f571250ce14e6ba0ddbc82b2050740'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.739597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1068/2166] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:58 2022] DELETE /identity/v3/users/82f571250ce14e6ba0ddbc82b2050740 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:58.811940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.814141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.831110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73ad62-6e14-4add-8a9e-d009786f14c2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.912640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.913782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.913897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.914095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] PATH_INFO: `/v3/projects/cb730baf947a4ae1a99ed282f82fa6de` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.915595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb730baf947a4ae1a99ed282f82fa6de)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.918288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.952502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:58.991734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb730baf947a4ae1a99ed282f82fa6de', 'request_id': 'req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.998703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb730baf947a4ae1a99ed282f82fa6de', 'request_id': 'req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.011874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb730baf947a4ae1a99ed282f82fa6de', 'request_id': 'req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.030225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] The token cache is being invalidate because project cb730baf947a4ae1a99ed282f82fa6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:59.030532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.031843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.038288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1099/2167] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:58 2022] DELETE /identity/v3/projects/cb730baf947a4ae1a99ed282f82fa6de => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:59.040698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32fd4-7832-4876-aa28-3ef2222c38dd None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.041047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32fd4-7832-4876-aa28-3ef2222c38dd None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.041421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32fd4-7832-4876-aa28-3ef2222c38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.063663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f8b32fd4-7832-4876-aa28-3ef2222c38dd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:59.065075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f8b32fd4-7832-4876-aa28-3ef2222c38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.116307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.119743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.133701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:59.155934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1069/2168] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:59.166352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.166644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.166924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.193044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:59.194979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.210760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1070/2169] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:59.211771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.216535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03503-fba2-4a32-81d9-3a01ad7c58a3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.222963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae78649-0edc-4dd1-8a13-4b327ad6a1a6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.223122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.224008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.224353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.224571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] PATH_INFO: `/v3/projects/909451b84f34474eb4a5f8542e8a4ae2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.225796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=909451b84f34474eb4a5f8542e8a4ae2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.227768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.227969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.228721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.229116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.229704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.230656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:59.231032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.232822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.253842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1071/2170] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:59.261534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.291756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d3f8-089e-4a37-9f1f-25cb7f3786b3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.303277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909451b84f34474eb4a5f8542e8a4ae2', 'request_id': 'req-c46138fb-f676-4be5-a99a-d1643aaf0c2b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.317696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909451b84f34474eb4a5f8542e8a4ae2', 'request_id': 'req-c46138fb-f676-4be5-a99a-d1643aaf0c2b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.326284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909451b84f34474eb4a5f8542e8a4ae2', 'request_id': 'req-c46138fb-f676-4be5-a99a-d1643aaf0c2b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.348361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] The token cache is being invalidate because project 909451b84f34474eb4a5f8542e8a4ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:59.348659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.349428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c46138fb-f676-4be5-a99a-d1643aaf0c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.351081 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1100/2171] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:59 2022] DELETE /identity/v3/projects/909451b84f34474eb4a5f8542e8a4ae2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:59.355841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00efc0-f103-4d04-8b66-eefc4047b63c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.356272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00efc0-f103-4d04-8b66-eefc4047b63c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.356577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00efc0-f103-4d04-8b66-eefc4047b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.372347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.373037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.373316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.373589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.374301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.375629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ab00efc0-f103-4d04-8b66-eefc4047b63c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:59.376257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.376995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ab00efc0-f103-4d04-8b66-eefc4047b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.385567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1101/2172] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:59.394131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.394477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.394723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.404054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1072/2173] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:59.408619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.410292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.416170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:59.417376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.451949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:59.480246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23cbe-5e80-437c-a1c3-57fee873a8d7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.485506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.486184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.486714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.486964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.487822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.490177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.493326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1102/2174] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:59.498291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.510549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031616-3968-45a0-87c5-1e17059c81b0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.515411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.516897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.517390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.517736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.518726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:59.519214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1073/2175] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:59.522386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.524341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.524701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.539478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fa5d0-5d23-449c-9e47-3ca7d8a8212d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.544726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1103/2176] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:59.546861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.547783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.548174 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.548539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.549405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.549531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.551187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.559803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346fe6-2b06-4c51-9549-d533b40d8149 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.564969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1074/2177] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:59.566856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.568596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.569369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.569730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.570082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.570876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.572880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.577501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c95140-cccc-4c42-a70e-be7226439641 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.583576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.584482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.584758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.585236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.586109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.587721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.600277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1075/2178] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:59.604201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.608074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1104/2179] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:59.609238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.614963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ecb57-aa7a-4141-ad97-6744f07d19b2 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.652230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:59.686562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dd6c6-29f6-4f4f-9539-0a940a42dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.688320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dd6c6-29f6-4f4f-9539-0a940a42dd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.688775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dd6c6-29f6-4f4f-9539-0a940a42dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.689237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dd6c6-29f6-4f4f-9539-0a940a42dd2f admin admin] PATH_INFO: `/v3/projects/09c9a5a5a04149b88860eaeb782b66c4/users/af4c7aed0fbc4b798bc4f481cf10a367/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.689558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab28de-b687-43df-9f37-b1b39ce89057 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.694405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.695092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.695441 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.695715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.696409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.698499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.709380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dd6c6-29f6-4f4f-9539-0a940a42dd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c9a5a5a04149b88860eaeb782b66c4, user_id=af4c7aed0fbc4b798bc4f481cf10a367, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.712355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dd6c6-29f6-4f4f-9539-0a940a42dd2f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.725958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1105/2180] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:59.728222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1076/2181] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:59 2022] PUT /identity/v3/projects/09c9a5a5a04149b88860eaeb782b66c4/users/af4c7aed0fbc4b798bc4f481cf10a367/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:59.730703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.739321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528defc-f561-4ce6-95b1-469110788cff None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.740118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528defc-f561-4ce6-95b1-469110788cff None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.740118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528defc-f561-4ce6-95b1-469110788cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.745600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec500b-7c11-499e-90b4-f3857ad68cdd admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.780332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-4528defc-f561-4ce6-95b1-469110788cff None None] MFA Rules not processed for user `af4c7aed0fbc4b798bc4f481cf10a367`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:59.782632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4528defc-f561-4ce6-95b1-469110788cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.836614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.837711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.837976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.838357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.839131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.840984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.853038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1106/2182] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:59.853748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.855586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.868336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df2b44-ff30-479a-9aef-714c742aab76 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.878227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.879296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.879790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.880136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] PATH_INFO: `/v3/users/457124861030491f8ec4b22b211c21bb` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.882076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457124861030491f8ec4b22b211c21bb)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.884707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.884817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1077/2183] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:59.885734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528defc-f561-4ce6-95b1-469110788cff None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.901725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528defc-f561-4ce6-95b1-469110788cff None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.907507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.908209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.908491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.909504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.910261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.912180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.915531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:59.926446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1078/2184] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:59.927608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.941212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eab271-7ea3-4e04-a7a0-6725e8f4562c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.947619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.948280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.948677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.948819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.949530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.951089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457124861030491f8ec4b22b211c21bb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.951952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.967180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457124861030491f8ec4b22b211c21bb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.975422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457124861030491f8ec4b22b211c21bb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.976164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457124861030491f8ec4b22b211c21bb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.987237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457124861030491f8ec4b22b211c21bb'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:59.992157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1079/2185] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:59.993380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.994179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1107/2186] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:59 2022] DELETE /identity/v3/users/457124861030491f8ec4b22b211c21bb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:59.996095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.997532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.997746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.087459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a9d6-1cbb-400f-86f5-fb41c1efd0e5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.092688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891848b-f921-4544-8691-47d407f00a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.093428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891848b-f921-4544-8691-47d407f00a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.093728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891848b-f921-4544-8691-47d407f00a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.094544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891848b-f921-4544-8691-47d407f00a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.094955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ada28-bf62-43f5-a241-33b9154d2600 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.095258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891848b-f921-4544-8691-47d407f00a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.097229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891848b-f921-4544-8691-47d407f00a3c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.100760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.101885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.102333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.102742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] PATH_INFO: `/v3/projects/23b0ed503e8a45ba9b4b4038d5abeba8/users/b0d75abdc69a42e39be363183115cd1a/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.126632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1108/2187] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:00.126632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6148788-d3c2-4f3e-a14c-fdbaae131ac9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.126632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6148788-d3c2-4f3e-a14c-fdbaae131ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.126632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6148788-d3c2-4f3e-a14c-fdbaae131ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.133507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b0ed503e8a45ba9b4b4038d5abeba8, user_id=b0d75abdc69a42e39be363183115cd1a, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.136221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.138724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:00.151958 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-d6148788-d3c2-4f3e-a14c-fdbaae131ac9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:00.153635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d6148788-d3c2-4f3e-a14c-fdbaae131ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.157368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1080/2188] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:59 2022] PUT /identity/v3/projects/23b0ed503e8a45ba9b4b4038d5abeba8/users/b0d75abdc69a42e39be363183115cd1a/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:00.158492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.244626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125817e-27c5-4a95-b404-97ad4a057bb0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.251127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.251669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1109/2189] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:00.252727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.253089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.253373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.254814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.255210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.255366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.256105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.257867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.271622 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1081/2190] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:00.272866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.276824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.289927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] MFA Rules not processed for user `b0d75abdc69a42e39be363183115cd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:00.291197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.309519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:00.342180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b1e6a-a2b8-468a-bf82-4438822f4b49 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.346892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.348444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.349050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.349477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.360579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.362377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.371358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1110/2191] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:00.371358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.379464 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e22b7-ff6f-46ee-abc1-461dca8cd706 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.381495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1082/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:00.382928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.385158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.386061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.386341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.386985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.387724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.389758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.393787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412f13-57db-4f22-9ad3-40d412f54be4 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.398974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.399763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.400149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.400524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.401627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.402365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1111/2193] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:00.403704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.407420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.418415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1da6-f0a3-4ba1-8bb8-105c3fbe617f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.425536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aad6e9-34ea-45b5-803e-36b34a7156b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.427107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad6e9-34ea-45b5-803e-36b34a7156b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.427620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad6e9-34ea-45b5-803e-36b34a7156b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.427973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aad6e9-34ea-45b5-803e-36b34a7156b1 admin admin] PATH_INFO: `/v3/projects/e6c4c895a3c0479d89831427a5499411/users/2a4861fdbcae4ef1a4c389310587f2b9/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.434283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1083/2194] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:00.439177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.448578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aad6e9-34ea-45b5-803e-36b34a7156b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c4c895a3c0479d89831427a5499411, user_id=2a4861fdbcae4ef1a4c389310587f2b9, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.452675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aad6e9-34ea-45b5-803e-36b34a7156b1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.471087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1112/2195] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:00 2022] PUT /identity/v3/projects/e6c4c895a3c0479d89831427a5499411/users/2a4861fdbcae4ef1a4c389310587f2b9/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:00.481189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.482119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.482119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.515430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] MFA Rules not processed for user `2a4861fdbcae4ef1a4c389310587f2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:00.516791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.517358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1617a9-34e5-4934-9998-5495038bbe3d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.539125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:00.596854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.597790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.598263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.598611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.599417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.601651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1113/2196] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:00.605106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.607205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.620754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cde34-86db-4d51-a9fe-464ebcd497f4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.626244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.626970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.627182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.627456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.628389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.633514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1084/2197] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:56:00.633679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.634101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.646088 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea925c-4180-436e-b339-05b4d775b769 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.652059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.652917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.653329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.653821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.654676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.657259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.660862 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1114/2198] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:00.665339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.675831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1085/2199] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:00.677400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.692206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47126ed2-c942-4827-bd3c-f7cf1386b279 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.725023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:00.739373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09977d7-1993-4db4-bac0-8ce590c265ec admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.744246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.744922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.745526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.745526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.746234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.748172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.754382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.755268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.755912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.755912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] PATH_INFO: `/v3/projects/077a5adb18b04d54bf737ca3c78263c5/users/bc0499588df34dfcb5167e459dafa86d/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.771519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077a5adb18b04d54bf737ca3c78263c5, user_id=bc0499588df34dfcb5167e459dafa86d, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.774230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.779326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1115/2200] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:56:00.780303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.782202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.789273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1086/2201] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:00 2022] PUT /identity/v3/projects/077a5adb18b04d54bf737ca3c78263c5/users/bc0499588df34dfcb5167e459dafa86d/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:00.790160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.797686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8bcb-4bfe-429e-8c97-68ddec794a18 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.854179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032e224-9df8-4f95-ab6a-ff0dced72f32 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.854436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.855396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.855589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.855892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] PATH_INFO: `/v3/projects/52ad8e34a343476996070e6a8a4d3e26` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.857102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ad8e34a343476996070e6a8a4d3e26)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.859144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.862804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.863494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.863938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.864221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.864979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.866750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.881128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1087/2202] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:00.881128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.890941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b363-3bb1-44df-91a8-a5bad0d99863 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.896120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.896780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.897143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.897444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.898513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.900180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.908808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ad8e34a343476996070e6a8a4d3e26', 'request_id': 'req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:00.911445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1088/2203] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:00.912258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.914870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ad8e34a343476996070e6a8a4d3e26', 'request_id': 'req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:00.918155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:00.922388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ad8e34a343476996070e6a8a4d3e26', 'request_id': 'req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:00.922743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cfd17-afb6-4fd8-9ae1-49beb39a56fa admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.935959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] The token cache is being invalidate because project 52ad8e34a343476996070e6a8a4d3e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:00.936251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:00.936892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:00.939319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1116/2204] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:00 2022] DELETE /identity/v3/projects/52ad8e34a343476996070e6a8a4d3e26 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:00.940249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.941654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.988028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.989177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.989463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.989741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] PATH_INFO: `/v3/projects/d8f902ca4495422ea1c0ad730290933d/users/7e02812245e24723986944460041b1ed/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.010456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f902ca4495422ea1c0ad730290933d, user_id=7e02812245e24723986944460041b1ed, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.013256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.029598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1089/2205] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:00 2022] PUT /identity/v3/projects/d8f902ca4495422ea1c0ad730290933d/users/7e02812245e24723986944460041b1ed/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:01.034442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:01.036386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.043111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacaca4-2190-4c34-b5b1-b83f5008c6ce admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.062383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:01.117141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bae2fb-6d49-438c-af22-6281f16ca679 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.121843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.122541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.122819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.123096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.123832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.123966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b929-64bc-4eb7-a56f-5e019d33f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.124837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b929-64bc-4eb7-a56f-5e019d33f4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.125753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b929-64bc-4eb7-a56f-5e019d33f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.126042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b929-64bc-4eb7-a56f-5e019d33f4c2 admin admin] PATH_INFO: `/v3/projects/077a5adb18b04d54bf737ca3c78263c5/users/bc0499588df34dfcb5167e459dafa86d/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.126507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.128562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426b929-64bc-4eb7-a56f-5e019d33f4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077a5adb18b04d54bf737ca3c78263c5, user_id=bc0499588df34dfcb5167e459dafa86d, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.131787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426b929-64bc-4eb7-a56f-5e019d33f4c2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.137665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1090/2206] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:01.143028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:01.145660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1117/2207] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:00 2022] PUT /identity/v3/projects/077a5adb18b04d54bf737ca3c78263c5/users/bc0499588df34dfcb5167e459dafa86d/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:01.153216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507bb9-a827-48cd-8a97-eafa4faad665 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.155717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.156012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.156423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.184542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] MFA Rules not processed for user `bc0499588df34dfcb5167e459dafa86d`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:01.185708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.212624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03e40e-2723-4804-bf64-ae0c5d1a9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.213553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03e40e-2723-4804-bf64-ae0c5d1a9822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.213835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03e40e-2723-4804-bf64-ae0c5d1a9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.214112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03e40e-2723-4804-bf64-ae0c5d1a9822 admin admin] PATH_INFO: `/v3/projects/d8f902ca4495422ea1c0ad730290933d/users/7e02812245e24723986944460041b1ed/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.216111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03e40e-2723-4804-bf64-ae0c5d1a9822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f902ca4495422ea1c0ad730290933d, user_id=7e02812245e24723986944460041b1ed, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.218840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03e40e-2723-4804-bf64-ae0c5d1a9822 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.229263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1091/2208] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:01 2022] PUT /identity/v3/projects/d8f902ca4495422ea1c0ad730290933d/users/7e02812245e24723986944460041b1ed/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:01.242339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.242637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.243514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.259851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1118/2209] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:01.272435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:01.274126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.286480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] MFA Rules not processed for user `7e02812245e24723986944460041b1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:01.287700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.293507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:01.332782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77562e93-d5c5-4aed-9acd-3d0c609ec985 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.360891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1092/2210] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:01.371859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:01.373280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.386110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.386789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.387073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.387348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.392652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:01.432756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e14c6e-c5b2-470f-bb11-853876d43d4d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.436509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.437130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.437451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.437936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.439777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.449476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.451026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.461584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1119/2211] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:01.509008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.510485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2f9d3-2b2e-427e-8c34-d83e5864bd57 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.520316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1093/2212] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:56:01.628158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:01.696956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9426d5-c087-4086-9cad-92d177398ff8 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.702056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.703563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.703907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.704219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] PATH_INFO: `/v3/users/b0d75abdc69a42e39be363183115cd1a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.705772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d75abdc69a42e39be363183115cd1a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.707826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.757504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d75abdc69a42e39be363183115cd1a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:01.783715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d75abdc69a42e39be363183115cd1a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:01.791356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d75abdc69a42e39be363183115cd1a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:01.792296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d75abdc69a42e39be363183115cd1a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:01.801348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d75abdc69a42e39be363183115cd1a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:01.808006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1120/2213] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:01 2022] DELETE /identity/v3/users/b0d75abdc69a42e39be363183115cd1a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:01.818397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.818857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.819000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.837470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:01.838786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.894079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:01.903737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1094/2214] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:01.913930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:01.915361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.942476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:01.975459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af004f4-3c68-44cb-a3d1-702c4349f751 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.979088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.979730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.980009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.980280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.989930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.991352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:02.000807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1121/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:02.267930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:02.269380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:02.284718 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e7d0-9098-409c-9b85-b1ef29baae40 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:02.293072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:02.294040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:02.294210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:02.294574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] PATH_INFO: `/v3/projects/23b0ed503e8a45ba9b4b4038d5abeba8` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:02.295781 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b0ed503e8a45ba9b4b4038d5abeba8)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:02.298226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:02.346781 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b0ed503e8a45ba9b4b4038d5abeba8', 'request_id': 'req-44ae5f34-d05b-4980-a69f-703a8f6e1379'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.352231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b0ed503e8a45ba9b4b4038d5abeba8', 'request_id': 'req-44ae5f34-d05b-4980-a69f-703a8f6e1379'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.359713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b0ed503e8a45ba9b4b4038d5abeba8', 'request_id': 'req-44ae5f34-d05b-4980-a69f-703a8f6e1379'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.370823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] The token cache is being invalidate because project 23b0ed503e8a45ba9b4b4038d5abeba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:02.371110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.371725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.373337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1095/2216] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:02 2022] DELETE /identity/v3/projects/23b0ed503e8a45ba9b4b4038d5abeba8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:02.377749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:02.387367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4f10-56af-494c-9544-483fddd73ebf service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:02.442834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:02.443730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:02.444010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:02.444285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] PATH_INFO: `/v3/users/bc0499588df34dfcb5167e459dafa86d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:02.445486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0499588df34dfcb5167e459dafa86d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:02.447419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:02.494439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0499588df34dfcb5167e459dafa86d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.506827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0499588df34dfcb5167e459dafa86d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.513707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0499588df34dfcb5167e459dafa86d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.514416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0499588df34dfcb5167e459dafa86d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.522243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bbf4ec9f-fb69-45a0-9a15-7978b2420a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0499588df34dfcb5167e459dafa86d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.529080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1122/2217] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:02 2022] DELETE /identity/v3/users/bc0499588df34dfcb5167e459dafa86d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:02.806762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:02.808199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:02.821865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5f34-d05b-4980-a69f-703a8f6e1379 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:02.883580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:02.884454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:02.884745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:02.885061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] PATH_INFO: `/v3/projects/077a5adb18b04d54bf737ca3c78263c5` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:02.886280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077a5adb18b04d54bf737ca3c78263c5)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:02.888223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:02.940179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077a5adb18b04d54bf737ca3c78263c5', 'request_id': 'req-3b6cf924-191d-4385-9a98-5a945117be92'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.945968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077a5adb18b04d54bf737ca3c78263c5', 'request_id': 'req-3b6cf924-191d-4385-9a98-5a945117be92'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.954004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077a5adb18b04d54bf737ca3c78263c5', 'request_id': 'req-3b6cf924-191d-4385-9a98-5a945117be92'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.966485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] The token cache is being invalidate because project 077a5adb18b04d54bf737ca3c78263c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:02.966770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.967390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3b6cf924-191d-4385-9a98-5a945117be92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:02.969503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1096/2218] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:02 2022] DELETE /identity/v3/projects/077a5adb18b04d54bf737ca3c78263c5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:02.978274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:02.978789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:02.978943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:02.997830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:02.999021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:03.040478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:03.061401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1123/2219] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:03.070164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.070454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.070759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.089590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:03.090792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:03.100884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1097/2220] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:03.105070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.115257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f65d-3dfa-4a26-a647-e930db277e3e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.120101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.120767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.121119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.121398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.122160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:56:03.122469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.124141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.135753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1124/2221] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:56:03.139963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.146092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:03.150175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeb8d2-fe81-4fd3-a66c-861b8417fd21 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.157227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.158175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.158496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.158943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.159666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.161815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.190302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1098/2222] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:03 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:03.194611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.205507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81a84c-e59b-4929-a2d2-d709dc72dd02 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.260520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.261228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.261513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.261791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.262471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.264396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.284681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1125/2223] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:03 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:03.288836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.299231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bee5e6-019d-4e3b-8e51-c377913918d8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.303678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.304325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.304605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.304875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.305695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.307269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.318145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1099/2224] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:03.321926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.332562 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac9c2c-1c8e-431f-8650-4eecf72c721b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.337224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e467b8-6811-4f92-8717-f10657e401b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.337889 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e467b8-6811-4f92-8717-f10657e401b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.338178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e467b8-6811-4f92-8717-f10657e401b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.338459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e467b8-6811-4f92-8717-f10657e401b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.339306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e467b8-6811-4f92-8717-f10657e401b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.341087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e467b8-6811-4f92-8717-f10657e401b9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.352366 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1126/2225] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:03.356340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.367660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dfe1b-fb4c-4f62-ae76-a2cce520ec39 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.372682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.373595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.373878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.374154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] PATH_INFO: `/v3/projects/32b2b7f96023490c99f9d34bbd1d5ade/users/18d85823bfa1409d82e3b3b3b4036c5b/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.395881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b2b7f96023490c99f9d34bbd1d5ade, user_id=18d85823bfa1409d82e3b3b3b4036c5b, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.398651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.413292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1100/2226] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:03 2022] PUT /identity/v3/projects/32b2b7f96023490c99f9d34bbd1d5ade/users/18d85823bfa1409d82e3b3b3b4036c5b/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:03.418458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.418752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.419034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.436677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:03.438876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:03.507947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1127/2227] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:03.517698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:03.520574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:03.602500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c55b7-2d63-494f-a389-dccc7de5a3ea admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:03.606464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b2916-1afc-4cd3-afad-3d5fb1ecacce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:03.607471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b2916-1afc-4cd3-afad-3d5fb1ecacce service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:03.607471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b2916-1afc-4cd3-afad-3d5fb1ecacce service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:03.607738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b2916-1afc-4cd3-afad-3d5fb1ecacce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:03.618721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b2916-1afc-4cd3-afad-3d5fb1ecacce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:03.620205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b2916-1afc-4cd3-afad-3d5fb1ecacce service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:03.631786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1101/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:04.102425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:04.103897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:04.169960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0f2a6-fabb-44b2-88e7-308043b5f826 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:04.174017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:04.174681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:04.174968 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:04.175274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:04.178117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:04.185964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:04.250816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:04.252355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:04.262457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1128/2229] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:04.950128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:04.950979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:04.951462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:04.972241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:04.973840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:04.983672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] MFA Rules not processed for user `18d85823bfa1409d82e3b3b3b4036c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:04.985861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:04.985982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf61d7-d768-420c-8f2b-7e11155de396 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:04.989885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:04.990647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:04.991026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:04.992044 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:04.994462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:05.060140 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1102/2230] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:05.065648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:05.087067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b5737-acf4-4d86-a7f7-d945fa2d5f18 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:05.093615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:05.094446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:05.095147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:05.095430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:05.096730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.100152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.112060 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.114032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.132629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1129/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:56:05.149568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1103/2232] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:05 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:05.153629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:05.173685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4c455-d858-4ace-96ca-71c7b186a0c5 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:05.241941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:05.242677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:05.243034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:05.243336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:05.244134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.246253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.274559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1130/2233] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:05 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:05.279038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:05.290436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77537105-195e-48e8-b0bf-e73f2916873d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:05.294986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:05.295638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:05.295918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:05.296189 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:05.297046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.298653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.311252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1104/2234] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:05.315733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:05.326008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879a9c-01d6-4be3-b5fb-fedfdae06edf admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:05.331524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:05.332410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:05.332717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:05.333102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] PATH_INFO: `/v3/projects/47b4849b14aa45fea48fa5087328ad4c/users/f729b2435049456e8898bb6a92094c39/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:05.348621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b4849b14aa45fea48fa5087328ad4c, user_id=f729b2435049456e8898bb6a92094c39, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.351338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.364299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1131/2235] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:05 2022] PUT /identity/v3/projects/47b4849b14aa45fea48fa5087328ad4c/users/f729b2435049456e8898bb6a92094c39/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:05.368326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:05.378256 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c55ee-2a4a-40e0-b7b8-7573152276c1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:05.381885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:05.437765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc1c7-225f-4f51-878c-4651121de84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:05.438540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc1c7-225f-4f51-878c-4651121de84d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:05.438827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc1c7-225f-4f51-878c-4651121de84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:05.439107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc1c7-225f-4f51-878c-4651121de84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:05.439831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fc1c7-225f-4f51-878c-4651121de84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.441472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fc1c7-225f-4f51-878c-4651121de84d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.453365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1105/2236] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:05.457753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:05.464476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:05.468339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ace537-177d-4f7c-a350-319d65f2c79f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:05.474433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:05.475315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:05.475597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:05.475906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] PATH_INFO: `/v3/projects/47b4849b14aa45fea48fa5087328ad4c/users/f729b2435049456e8898bb6a92094c39/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:05.477909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b4849b14aa45fea48fa5087328ad4c, user_id=f729b2435049456e8898bb6a92094c39, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:05.480581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:05.491981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1132/2237] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:05 2022] PUT /identity/v3/projects/47b4849b14aa45fea48fa5087328ad4c/users/f729b2435049456e8898bb6a92094c39/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:06.120675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:06.121249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:06.121249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:06.149745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] MFA Rules not processed for user `f729b2435049456e8898bb6a92094c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:06.151611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:06.233848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1106/2238] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:06.245905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:06.324982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d813a-a3d0-4237-9cd4-65fca33e9b50 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:06.329213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:06.329867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:06.330355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:06.330476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:06.409169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:06.410666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:06.420183 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1133/2239] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:07.819797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:07.830666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552e72-f272-4597-9dbe-33f7f12d14b9 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:07.834298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc935604-a24f-465b-b728-c08e98efbb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:07.835076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935604-a24f-465b-b728-c08e98efbb38 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:07.835363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935604-a24f-465b-b728-c08e98efbb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:07.835639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc935604-a24f-465b-b728-c08e98efbb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:07.846183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc935604-a24f-465b-b728-c08e98efbb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:07.847780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc935604-a24f-465b-b728-c08e98efbb38 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:07.859979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1107/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:09.084429 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:09.086041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.163610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b1c9-58c1-46ff-ad85-6ac95bc26fb9 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:09.168309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:09.169318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.169620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.169946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] PATH_INFO: `/v3/users/af4c7aed0fbc4b798bc4f481cf10a367` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.171246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4c7aed0fbc4b798bc4f481cf10a367)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:09.174058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:09.224825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4c7aed0fbc4b798bc4f481cf10a367'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.226063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:09.241786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4c7aed0fbc4b798bc4f481cf10a367'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.250452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4c7aed0fbc4b798bc4f481cf10a367'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.252571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4c7aed0fbc4b798bc4f481cf10a367'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.261781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4c7aed0fbc4b798bc4f481cf10a367'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.268300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1134/2241] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:09 2022] DELETE /identity/v3/users/af4c7aed0fbc4b798bc4f481cf10a367 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:09.272600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.273300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.273300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.293464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:09.294910 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.370238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1108/2242] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:09.381604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:09.385983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.386839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:09.388494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.409119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e88439-3d99-4e40-8098-02c90158cd48 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:09.418124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:09.420148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.421145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.421805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] PATH_INFO: `/v3/users/f59a0812c76b48e9ab359edfeec7bb7c` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.424380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59a0812c76b48e9ab359edfeec7bb7c)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:09.428719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:09.446764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:09.464502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f1636-41f0-42a0-a062-60d283a53713 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:09.472957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c560a5-45c9-4a31-afd3-729bfebb1bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:09.472957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c560a5-45c9-4a31-afd3-729bfebb1bdb service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.472957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c560a5-45c9-4a31-afd3-729bfebb1bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.472957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c560a5-45c9-4a31-afd3-729bfebb1bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.486722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c560a5-45c9-4a31-afd3-729bfebb1bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:09.486722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c560a5-45c9-4a31-afd3-729bfebb1bdb service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:09.496296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59a0812c76b48e9ab359edfeec7bb7c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.498630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1135/2243] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:09.509172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59a0812c76b48e9ab359edfeec7bb7c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.515913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59a0812c76b48e9ab359edfeec7bb7c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.517562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59a0812c76b48e9ab359edfeec7bb7c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.525437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59a0812c76b48e9ab359edfeec7bb7c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.532311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1109/2244] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:09 2022] DELETE /identity/v3/users/f59a0812c76b48e9ab359edfeec7bb7c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:09.536851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.537200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.537480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.555543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:09.556873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.620887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1136/2245] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:09.630967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:09.632389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.707364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b822d0-e5b6-4a3d-8997-325458592b43 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:09.711087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:09.711794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.712083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.712352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.722280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:09.723750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:09.734878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1110/2246] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:09.825058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:09.826690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:09.840462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa105fc9-e07c-4ff4-9398-51e2346117b7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:09.847503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:09.848419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:09.848705 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:09.849019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] PATH_INFO: `/v3/projects/09c9a5a5a04149b88860eaeb782b66c4` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:09.850248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c9a5a5a04149b88860eaeb782b66c4)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:09.852179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:09.913535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c9a5a5a04149b88860eaeb782b66c4', 'request_id': 'req-4ef00805-3699-4d02-aad6-5cc234e58e58'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.919895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c9a5a5a04149b88860eaeb782b66c4', 'request_id': 'req-4ef00805-3699-4d02-aad6-5cc234e58e58'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.927616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c9a5a5a04149b88860eaeb782b66c4', 'request_id': 'req-4ef00805-3699-4d02-aad6-5cc234e58e58'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.932281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:09.950646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] The token cache is being invalidate because project 09c9a5a5a04149b88860eaeb782b66c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:09.950956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.952011 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:09.956041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1137/2247] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:09 2022] DELETE /identity/v3/projects/09c9a5a5a04149b88860eaeb782b66c4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:09.960122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:09.972985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5421-8e89-48c1-af72-6395068cd3f3 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.035692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.036670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.037093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.037470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] PATH_INFO: `/v3/users/2a4861fdbcae4ef1a4c389310587f2b9` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.038791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4861fdbcae4ef1a4c389310587f2b9)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.041047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.082331 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.084357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.087187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:10.102635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4861fdbcae4ef1a4c389310587f2b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.112285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00805-3699-4d02-aad6-5cc234e58e58 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.116736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4861fdbcae4ef1a4c389310587f2b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.118334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.119261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.119540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.119809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] PATH_INFO: `/v3/projects/392920afa6ea456abc3b68e3fc13aff0` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.121050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=392920afa6ea456abc3b68e3fc13aff0)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.123333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.126353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4861fdbcae4ef1a4c389310587f2b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.127291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4861fdbcae4ef1a4c389310587f2b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.135045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e9e0071d-2d16-46ca-8b41-0eecbe146b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4861fdbcae4ef1a4c389310587f2b9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.141745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1111/2248] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:09 2022] DELETE /identity/v3/users/2a4861fdbcae4ef1a4c389310587f2b9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:10.176723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392920afa6ea456abc3b68e3fc13aff0', 'request_id': 'req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.186625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392920afa6ea456abc3b68e3fc13aff0', 'request_id': 'req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.193722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392920afa6ea456abc3b68e3fc13aff0', 'request_id': 'req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.207423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] The token cache is being invalidate because project 392920afa6ea456abc3b68e3fc13aff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:10.207801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.208566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-863dea28-3d59-4e2f-b6d0-3eca6b4c8df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.210200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1138/2249] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:10 2022] DELETE /identity/v3/projects/392920afa6ea456abc3b68e3fc13aff0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:10.215391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.215683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.215964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.235650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:10.237045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.307827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1112/2250] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:10.316189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.316479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.316761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.336336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:10.337845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.347394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1139/2251] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:10.351293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.361637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c30f0-7850-413d-9a9b-1986b05b8a00 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.367283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.367951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.368229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.368874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.369262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:56:10.369567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.371187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.389556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1113/2252] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:56:10.393813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.403835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2d355-1deb-41ea-8c55-f6d10e48a821 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.409294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.409988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.410232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.410506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.411203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.413240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.438543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.445360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.465911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1140/2253] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:10 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:10.467059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.467739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19e09-537c-4bc0-9180-92934397bbf7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.550268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b386ab1-29bf-481c-930f-18f2d9b96a9e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.554393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.555378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.555512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.555737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.555931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] PATH_INFO: `/v3/projects/e6c4c895a3c0479d89831427a5499411` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.556167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.556480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.556788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.557587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.557764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c4c895a3c0479d89831427a5499411)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.559565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.562607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.585006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1141/2254] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:10 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:10.588750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.600547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf6167-a66e-46ae-b576-8188af2bd604 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.605995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.606820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.607098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.607373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.608161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.609790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.613563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:10.620177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c4c895a3c0479d89831427a5499411', 'request_id': 'req-c756668b-c0c8-4353-8a7d-49ed40217646'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.626992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c4c895a3c0479d89831427a5499411', 'request_id': 'req-c756668b-c0c8-4353-8a7d-49ed40217646'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.628338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1142/2255] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:56:10.632740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.644170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c4c895a3c0479d89831427a5499411', 'request_id': 'req-c756668b-c0c8-4353-8a7d-49ed40217646'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.648485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6fe1-92ab-41c8-9ccd-45c5f4b65d07 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.661522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] The token cache is being invalidate because project e6c4c895a3c0479d89831427a5499411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:10.661807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.662583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.664977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1114/2256] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:10 2022] DELETE /identity/v3/projects/e6c4c895a3c0479d89831427a5499411 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:10.668665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.675181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.679493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=6,keystone:DELETE=8,keystone:SELECT=86 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:10.739134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.740583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.740956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.741335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.742135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.743761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.760402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1143/2257] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:56:10.761616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.762176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756668b-c0c8-4353-8a7d-49ed40217646 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.764197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.769583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.770476 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.770756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.771029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] PATH_INFO: `/v3/users/7e02812245e24723986944460041b1ed` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.772735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e02812245e24723986944460041b1ed)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.774213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.778971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d29d4c-6dd3-4b65-be40-905f80f5d609 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:10.785601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc7e51-741d-4822-9926-b65338405ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:10.786495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7e51-741d-4822-9926-b65338405ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.786778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7e51-741d-4822-9926-b65338405ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.787054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7e51-741d-4822-9926-b65338405ba7 admin admin] PATH_INFO: `/v3/projects/ad77ae7f60554a83b3b21656d279ec6f/users/5b89657a8ef54d23ae6efa986771fc3e/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.804013 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc7e51-741d-4822-9926-b65338405ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad77ae7f60554a83b3b21656d279ec6f, user_id=5b89657a8ef54d23ae6efa986771fc3e, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:10.806939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc7e51-741d-4822-9926-b65338405ba7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:10.821641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1144/2258] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:10 2022] PUT /identity/v3/projects/ad77ae7f60554a83b3b21656d279ec6f/users/5b89657a8ef54d23ae6efa986771fc3e/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:10.827301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e02812245e24723986944460041b1ed'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.832475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:10.832766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:10.833073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:10.840469 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e02812245e24723986944460041b1ed'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.847299 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e02812245e24723986944460041b1ed'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.848013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e02812245e24723986944460041b1ed'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.855334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e02812245e24723986944460041b1ed'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:10.859682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] MFA Rules not processed for user `5b89657a8ef54d23ae6efa986771fc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:10.861543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:10.861789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1115/2259] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:10 2022] DELETE /identity/v3/users/7e02812245e24723986944460041b1ed => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:10.934124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1145/2260] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:10.946583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:10.948205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.010865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:11.018943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd783c2-3e82-44e8-bc75-a136f006181d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.025326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.027132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.028048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.028516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.041020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.042480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.053347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1116/2261] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:11.086423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.088100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.159323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb49c-d87d-4f9c-a723-dc4d5f9d9ca0 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.163984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.165308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.165308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.165630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] PATH_INFO: `/v3/users/5b89657a8ef54d23ae6efa986771fc3e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.167263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b89657a8ef54d23ae6efa986771fc3e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.169344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.217414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.219115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.221150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:11.239970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ac270-0815-4e56-9e8d-3079fb6a57b2 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.245489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.246634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.247128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.247477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] PATH_INFO: `/v3/projects/d8f902ca4495422ea1c0ad730290933d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.248776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f902ca4495422ea1c0ad730290933d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.248891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b89657a8ef54d23ae6efa986771fc3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.251821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.265972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b89657a8ef54d23ae6efa986771fc3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.276393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b89657a8ef54d23ae6efa986771fc3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.276393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b89657a8ef54d23ae6efa986771fc3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.282588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b628bbc0-bedc-4e8a-939b-eb9635f6a2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b89657a8ef54d23ae6efa986771fc3e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.291724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1146/2262] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:11 2022] DELETE /identity/v3/users/5b89657a8ef54d23ae6efa986771fc3e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:11.293210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.293624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.293817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.312813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:11.314323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.315703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f902ca4495422ea1c0ad730290933d', 'request_id': 'req-81f4e5eb-ec49-4285-bff2-1f69333cb625'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.326243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f902ca4495422ea1c0ad730290933d', 'request_id': 'req-81f4e5eb-ec49-4285-bff2-1f69333cb625'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.337075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f902ca4495422ea1c0ad730290933d', 'request_id': 'req-81f4e5eb-ec49-4285-bff2-1f69333cb625'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.348997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] The token cache is being invalidate because project d8f902ca4495422ea1c0ad730290933d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:11.349292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.349936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-81f4e5eb-ec49-4285-bff2-1f69333cb625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.351821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1117/2263] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:11 2022] DELETE /identity/v3/projects/d8f902ca4495422ea1c0ad730290933d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:11.356128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba07d8-27fa-4e26-9d03-789161cf4a36 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.356421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba07d8-27fa-4e26-9d03-789161cf4a36 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.356701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba07d8-27fa-4e26-9d03-789161cf4a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.375293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-36ba07d8-27fa-4e26-9d03-789161cf4a36 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:11.377046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-36ba07d8-27fa-4e26-9d03-789161cf4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.380241 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1147/2264] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:11.394467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1118/2265] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:11.394885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.394885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.395942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.396233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.396509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.416750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:11.418084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.427697 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1119/2266] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:11.432066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.441904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511535c1-8b31-4028-805a-a8674e7cb7f2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.446686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.447355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.447639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.447918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.448649 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:56:11.449016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.450632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.455519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe201b0-735f-49ba-91f4-9b4e65d7a494 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.459353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.460244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.460530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.460881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.466165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1120/2267] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:56:11.467338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.470800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.472236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.477178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450e5a-7a99-4e2a-b1c7-3213b0509f73 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.482245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.482946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.483238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.483504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.484204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.486838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.487737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1148/2268] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:56:11.520451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1121/2269] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:11 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:56:11.521610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.536798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454673ae-8f72-4915-a1f9-55da87cea8d9 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.590112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:11.604955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.605585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.605874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.606157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.606961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.609143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.636157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1149/2270] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:11 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:56:11.637549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.648769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f6e77-33ee-46e5-96da-6ade782d188f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.654661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.655545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.655756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.656155 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.657232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.659196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.669707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1122/2271] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:11.673925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.684974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0248b82-b892-4cf2-82b2-531a6e319059 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.690616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67237b32-2c88-4c24-8c35-bcbd698b504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.691324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237b32-2c88-4c24-8c35-bcbd698b504d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.691610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237b32-2c88-4c24-8c35-bcbd698b504d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.691890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67237b32-2c88-4c24-8c35-bcbd698b504d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.692658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67237b32-2c88-4c24-8c35-bcbd698b504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.694314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67237b32-2c88-4c24-8c35-bcbd698b504d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.705320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1150/2272] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:11.709972 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.720749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b448c0-44c5-4118-b41b-475122d6ea83 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.725402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.726289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.726571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.726845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] PATH_INFO: `/v3/projects/a407f0bf436c4987b9eb2e59c46d82a9/users/fd273630a84d41f49dcf8208c618f256/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.745947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a407f0bf436c4987b9eb2e59c46d82a9, user_id=fd273630a84d41f49dcf8208c618f256, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.748717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.769492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1123/2273] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:11 2022] PUT /identity/v3/projects/a407f0bf436c4987b9eb2e59c46d82a9/users/fd273630a84d41f49dcf8208c618f256/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:11.771358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.771871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.772374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.802185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.803185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:11.803901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.804599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.871500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:11.879318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1151/2274] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:11.890362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:11.891872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:11.899449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02898-32cf-40cc-9c18-59cbd5758a56 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.904672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:11.905602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:11.905888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:11.906168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] PATH_INFO: `/v3/projects/ad77ae7f60554a83b3b21656d279ec6f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:11.908047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad77ae7f60554a83b3b21656d279ec6f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:11.910011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:11.960900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110fd7-4d37-4091-a539-302dad73fab4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:11.972027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad77ae7f60554a83b3b21656d279ec6f', 'request_id': 'req-26f76d84-ceeb-4fb7-b420-1f3c30a74752'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.979685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad77ae7f60554a83b3b21656d279ec6f', 'request_id': 'req-26f76d84-ceeb-4fb7-b420-1f3c30a74752'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:11.990275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad77ae7f60554a83b3b21656d279ec6f', 'request_id': 'req-26f76d84-ceeb-4fb7-b420-1f3c30a74752'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:12.008059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] The token cache is being invalidate because project ad77ae7f60554a83b3b21656d279ec6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:12.008424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:12.009136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-26f76d84-ceeb-4fb7-b420-1f3c30a74752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:12.010921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1124/2275] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:11 2022] DELETE /identity/v3/projects/ad77ae7f60554a83b3b21656d279ec6f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:12.038038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:12.038765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:12.039028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:12.039310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:12.041659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:12.105210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:12.144496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:12.146408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:12.165190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1152/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:13.058352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8fa58-ef3a-4341-ad75-79004cfd2323 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:13.058922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8fa58-ef3a-4341-ad75-79004cfd2323 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:13.059021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8fa58-ef3a-4341-ad75-79004cfd2323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:13.085993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b1d8fa58-ef3a-4341-ad75-79004cfd2323 None None] MFA Rules not processed for user `fd273630a84d41f49dcf8208c618f256`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:13.087242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b1d8fa58-ef3a-4341-ad75-79004cfd2323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:13.159029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1125/2277] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:13.168612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:13.170162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:13.243532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac67766-3d4f-4752-974a-43785b267886 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:13.247308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7f013-2dac-40dc-8c84-422ca68d859c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:13.247996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7f013-2dac-40dc-8c84-422ca68d859c service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:13.248976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7f013-2dac-40dc-8c84-422ca68d859c service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:13.248976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7f013-2dac-40dc-8c84-422ca68d859c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:13.258909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7f013-2dac-40dc-8c84-422ca68d859c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:13.260373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7f013-2dac-40dc-8c84-422ca68d859c service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:13.275476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1153/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:56:14.680436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee652a1a-26b9-4521-8cc1-b2e3150350eb None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:14.681009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee652a1a-26b9-4521-8cc1-b2e3150350eb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:14.681121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee652a1a-26b9-4521-8cc1-b2e3150350eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:14.700797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ee652a1a-26b9-4521-8cc1-b2e3150350eb None None] MFA Rules not processed for user `fd273630a84d41f49dcf8208c618f256`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:14.702117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ee652a1a-26b9-4521-8cc1-b2e3150350eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:14.710470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1126/2279] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:21.426319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6444-0368-4a2d-813c-b26be3e21412 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:21.426839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6444-0368-4a2d-813c-b26be3e21412 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:21.426839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6444-0368-4a2d-813c-b26be3e21412 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:21.428158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1154/2280] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:56:21.445916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:21.446449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:21.446637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:21.464839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] MFA Rules not processed for user `3acb6587f284491ea5854898abfbc4fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:21.466363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:21.527471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:21.541897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1127/2281] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:21.558424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a6444-0368-4a2d-813c-b26be3e21412 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:21.560275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5a6a6444-0368-4a2d-813c-b26be3e21412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:21.574309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:21.575746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:21.583180 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a6444-0368-4a2d-813c-b26be3e21412 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:21.589493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:21.590259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:21.590546 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:21.590821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:21.594254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c7cd4-d906-413f-b936-d7f458f19169 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:21.599173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:21.599734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:21.600045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:21.600329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:21.600606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] PATH_INFO: `/v3/users/18d85823bfa1409d82e3b3b3b4036c5b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:21.601370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:21.601844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d85823bfa1409d82e3b3b3b4036c5b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:21.603770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:21.611427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1155/2282] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:21.653503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d85823bfa1409d82e3b3b3b4036c5b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.665249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d85823bfa1409d82e3b3b3b4036c5b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.672485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d85823bfa1409d82e3b3b3b4036c5b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.673270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d85823bfa1409d82e3b3b3b4036c5b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.680464 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d85823bfa1409d82e3b3b3b4036c5b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.686277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1128/2283] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:21 2022] DELETE /identity/v3/users/18d85823bfa1409d82e3b3b3b4036c5b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:21.860229 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:21.871722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a224e1-2b68-45f9-83e8-20e1d5716732 service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:21.933028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:21.934005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:21.934319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:21.934602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] PATH_INFO: `/v3/projects/32b2b7f96023490c99f9d34bbd1d5ade` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:21.935801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b2b7f96023490c99f9d34bbd1d5ade)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:21.938602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:21.987566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b2b7f96023490c99f9d34bbd1d5ade', 'request_id': 'req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.993091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b2b7f96023490c99f9d34bbd1d5ade', 'request_id': 'req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:21.999337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b2b7f96023490c99f9d34bbd1d5ade', 'request_id': 'req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.002632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:22.014751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] The token cache is being invalidate because project 32b2b7f96023490c99f9d34bbd1d5ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:22.015050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.016191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.017913 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1156/2284] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:21 2022] DELETE /identity/v3/projects/32b2b7f96023490c99f9d34bbd1d5ade => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:22.021914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:22.023553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:22.037564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccdb55-0348-4c5e-99aa-c686c47c29dd admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:22.102170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:22.105809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:22.106120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:22.106401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] PATH_INFO: `/v3/users/f729b2435049456e8898bb6a92094c39` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:22.108296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f729b2435049456e8898bb6a92094c39)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:22.111049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:22.167552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f729b2435049456e8898bb6a92094c39'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.183595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f729b2435049456e8898bb6a92094c39'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.189575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:22.192887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f729b2435049456e8898bb6a92094c39'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.194352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f729b2435049456e8898bb6a92094c39'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.206472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7f21e3d4-5fb9-4950-839b-2bf7e49c758b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f729b2435049456e8898bb6a92094c39'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.233909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1129/2285] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:22 2022] DELETE /identity/v3/users/f729b2435049456e8898bb6a92094c39 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:22.464757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:22.466401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:22.481317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6ed2f-bedb-4d9f-a733-73b50fe09544 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:22.555987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:22.558502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:22.558502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:22.558502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] PATH_INFO: `/v3/projects/47b4849b14aa45fea48fa5087328ad4c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:22.558940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b4849b14aa45fea48fa5087328ad4c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:22.560981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:22.610760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b4849b14aa45fea48fa5087328ad4c', 'request_id': 'req-75bf93a7-9f99-4923-b2b5-b88355dfff8f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.616372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b4849b14aa45fea48fa5087328ad4c', 'request_id': 'req-75bf93a7-9f99-4923-b2b5-b88355dfff8f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.622738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b4849b14aa45fea48fa5087328ad4c', 'request_id': 'req-75bf93a7-9f99-4923-b2b5-b88355dfff8f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.635574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] The token cache is being invalidate because project 47b4849b14aa45fea48fa5087328ad4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:22.635861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.636494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-75bf93a7-9f99-4923-b2b5-b88355dfff8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:22.638416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1157/2286] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:22 2022] DELETE /identity/v3/projects/47b4849b14aa45fea48fa5087328ad4c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:22.647016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:22.647535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:22.647783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:22.669607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:22.670813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:22.745987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1130/2287] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:22.813335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:22.813721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:22.814024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:22.833468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:22.834676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:22.846688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1158/2288] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:22.847884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:22.858821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8765ff6-7c1c-4425-8bf5-2acee9215b47 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:22.864484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:22.865066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:22.865349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:22.865628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:22.866358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:56:22.866659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:22.869013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:22.881713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1131/2289] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:56:22.886135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:22.896105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e3c8-a629-40c0-b230-78849c48cc68 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:22.902525 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:22.903378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:22.904125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:22.904471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:22.905485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:22.909293 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:22.940988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1159/2290] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:22 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:22.942417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:22.955113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc96bc-8ce4-4b7b-948a-ba4db9561a6a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:23.013000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:23.013803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:23.013962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:23.014240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:23.014942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:23.017503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:23.058219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1132/2291] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:22 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:23.059996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:23.088026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1c2b-64db-4663-ab5e-248d3faa7e32 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:23.097750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:23.098622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:23.098982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:23.099333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:23.100219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:23.102059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:23.116831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1160/2292] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:23.118158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:23.131285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0493a82-b7e5-4e3e-a52d-618f650fda5f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:23.138398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669e133-9ec4-49bd-88f0-ec04a5da6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:23.139262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e133-9ec4-49bd-88f0-ec04a5da6f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:23.139692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e133-9ec4-49bd-88f0-ec04a5da6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:23.140254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669e133-9ec4-49bd-88f0-ec04a5da6f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:23.141550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669e133-9ec4-49bd-88f0-ec04a5da6f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:23.145280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669e133-9ec4-49bd-88f0-ec04a5da6f31 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:23.162726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1133/2293] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:23.166493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:23.180722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0840d1c-53c5-4a61-9019-fc561c9be146 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:23.190162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:23.191301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:23.191650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:23.191930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] PATH_INFO: `/v3/projects/6c9a3d56f8b84eb2a057425afbf79079/users/261feb03a8ff459b8874232bec05034f/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:23.215808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9a3d56f8b84eb2a057425afbf79079, user_id=261feb03a8ff459b8874232bec05034f, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:23.218907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:23.241645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1161/2294] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:23 2022] PUT /identity/v3/projects/6c9a3d56f8b84eb2a057425afbf79079/users/261feb03a8ff459b8874232bec05034f/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:23.243510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247967-8174-4bb1-b647-f0301e55a022 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:23.244291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247967-8174-4bb1-b647-f0301e55a022 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:23.244577 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4247967-8174-4bb1-b647-f0301e55a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:23.269695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c4247967-8174-4bb1-b647-f0301e55a022 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:23.270312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c4247967-8174-4bb1-b647-f0301e55a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:23.343353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:23.371954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1134/2295] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:23.372646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:23.374400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:23.407500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:23.463346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d737c-2183-45a6-84c4-d1995af96955 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:23.468113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658eaa1-b2e6-4b22-bfca-0b64a34d77ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:23.471239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658eaa1-b2e6-4b22-bfca-0b64a34d77ae service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:23.471840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658eaa1-b2e6-4b22-bfca-0b64a34d77ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:23.472390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658eaa1-b2e6-4b22-bfca-0b64a34d77ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:23.485092 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658eaa1-b2e6-4b22-bfca-0b64a34d77ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:23.486852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658eaa1-b2e6-4b22-bfca-0b64a34d77ae service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:23.501336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1162/2296] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:56:26.590312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:26.591655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:26.592616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:26.617580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] MFA Rules not processed for user `d152763a64794301b21587ab2b395bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:26.619303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:26.726191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1135/2297] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:30.221693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.222235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.222320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.252200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] MFA Rules not processed for user `261feb03a8ff459b8874232bec05034f`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:30.253440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:30.348143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:30.356503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1163/2298] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:30.361262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec33b-701b-433a-add9-36c9d8243d0f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:30.366506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:30.367582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.368078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.392337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.393460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:30.396470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:30.472762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1136/2299] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:30 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:30.473906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:30.488117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ec92b-fcf3-4e90-b67a-520f13ffd052 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:30.570982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:30.572001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.572431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.572984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.574107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:30.577301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:30.603605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1164/2300] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:30 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:30.607318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:30.620292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5223-e363-4974-b7c3-b44346a4ed20 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:30.637371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:30.638429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.638895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.639382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.640947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:30.642845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:30.655607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1137/2301] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:56:30.663294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:30.678084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c03343-b843-419d-bb04-e6936d3cd8b8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:30.682780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:30.683668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.683946 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.684221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] PATH_INFO: `/v3/projects/5274bd07a0f244578a90b725fe87c94e/users/7d7e12f1b5b942249a481ee82e7045fe/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.700650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5274bd07a0f244578a90b725fe87c94e, user_id=7d7e12f1b5b942249a481ee82e7045fe, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:30.703457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:30.718706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1165/2302] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:30 2022] PUT /identity/v3/projects/5274bd07a0f244578a90b725fe87c94e/users/7d7e12f1b5b942249a481ee82e7045fe/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:30.722953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:30.733173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452edda0-708e-4f65-88e9-c30f8d36837c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:30.842350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ab0c0-a21a-4a93-9a2f-1eb13446ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:30.843518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab0c0-a21a-4a93-9a2f-1eb13446ed6d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.844092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab0c0-a21a-4a93-9a2f-1eb13446ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.844566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ab0c0-a21a-4a93-9a2f-1eb13446ed6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.845736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ab0c0-a21a-4a93-9a2f-1eb13446ed6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:30.847606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ab0c0-a21a-4a93-9a2f-1eb13446ed6d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:30.859772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1138/2303] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:56:30.867037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:30.880107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf03027-eddf-4e24-888e-0c45e4044d5e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:30.890725 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:30.892194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:30.892194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:30.892404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] PATH_INFO: `/v3/projects/5274bd07a0f244578a90b725fe87c94e/users/7d7e12f1b5b942249a481ee82e7045fe/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:30.898109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5274bd07a0f244578a90b725fe87c94e, user_id=7d7e12f1b5b942249a481ee82e7045fe, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:30.900597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:30.928340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1166/2304] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:30 2022] PUT /identity/v3/projects/5274bd07a0f244578a90b725fe87c94e/users/7d7e12f1b5b942249a481ee82e7045fe/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:38.176896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91148b89-a5ee-488c-8b32-650f09a02939 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:38.177425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91148b89-a5ee-488c-8b32-650f09a02939 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:38.177524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91148b89-a5ee-488c-8b32-650f09a02939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:38.208729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-91148b89-a5ee-488c-8b32-650f09a02939 None None] MFA Rules not processed for user `7d7e12f1b5b942249a481ee82e7045fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:38.210076 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-91148b89-a5ee-488c-8b32-650f09a02939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:38.298552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:38.321615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1139/2305] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:38.336412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:38.338177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:38.347315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:38.475670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c3d-4e5b-4b48-918c-afe61a57b666 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:38.482559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:38.484045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:38.484489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:38.484996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:38.632731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:38.634728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:38.649099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1167/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:39.220689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202e3d-3f19-4342-858c-e9dfad6966bb None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:39.221504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202e3d-3f19-4342-858c-e9dfad6966bb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:39.221504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f202e3d-3f19-4342-858c-e9dfad6966bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:39.242246 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2f202e3d-3f19-4342-858c-e9dfad6966bb None None] MFA Rules not processed for user `fd273630a84d41f49dcf8208c618f256`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:39.243843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2f202e3d-3f19-4342-858c-e9dfad6966bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:39.338424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1140/2307] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:48.641724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=54 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:49.327279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=30 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:52.044639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:52.046396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:52.111080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2516-ebc0-4e0e-be10-38024e5ead71 service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:52.117339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:52.118032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:52.118311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:52.118595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:52.120379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:52.205463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:52.207318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:52.219205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1168/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:54.546257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797e56-2e1e-4d96-b9cd-63d70da223e9 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:54.546757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797e56-2e1e-4d96-b9cd-63d70da223e9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:54.547192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4797e56-2e1e-4d96-b9cd-63d70da223e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:54.582789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f4797e56-2e1e-4d96-b9cd-63d70da223e9 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:54.585288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f4797e56-2e1e-4d96-b9cd-63d70da223e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:54.691554 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1141/2309] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:56:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:56:54.752499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:54.755122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:54.943736 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04b40-1380-44bc-bfa7-d633eb6c5d6f service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:54.950144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13579f26-aebd-410c-a9f3-44a9603b8724 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:54.951028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579f26-aebd-410c-a9f3-44a9603b8724 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:54.951630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579f26-aebd-410c-a9f3-44a9603b8724 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:54.951960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13579f26-aebd-410c-a9f3-44a9603b8724 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:54.963356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13579f26-aebd-410c-a9f3-44a9603b8724 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:54.964998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13579f26-aebd-410c-a9f3-44a9603b8724 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:54.970989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:54.976647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1169/2310] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:56:59.075587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:59.077261 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:59.078271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:59.098165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] MFA Rules not processed for user `261feb03a8ff459b8874232bec05034f`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:59.104732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:59.115437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1142/2311] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:03.694505 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace92a1-3a2e-425f-be67-dacaa728e2e6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:03.695112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace92a1-3a2e-425f-be67-dacaa728e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:03.695375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace92a1-3a2e-425f-be67-dacaa728e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:03.721631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4ace92a1-3a2e-425f-be67-dacaa728e2e6 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:03.722781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4ace92a1-3a2e-425f-be67-dacaa728e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:03.730928 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1170/2312] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:03.746347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:03.767714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc7549-d36a-410d-8ee7-a382feb90b9a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:03.785687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61121d3-5cef-4b88-83a2-a6893e42bbd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:03.786784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61121d3-5cef-4b88-83a2-a6893e42bbd2 service swift] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:03.787245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61121d3-5cef-4b88-83a2-a6893e42bbd2 service swift] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:03.787959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61121d3-5cef-4b88-83a2-a6893e42bbd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:03.803061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61121d3-5cef-4b88-83a2-a6893e42bbd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:03.804888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61121d3-5cef-4b88-83a2-a6893e42bbd2 service swift] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:03.824055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1143/2313] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:57:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:57:11.648593 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e089-b430-42ac-a9c7-fc13d48a25bb None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:11.649539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e089-b430-42ac-a9c7-fc13d48a25bb None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:11.649718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e089-b430-42ac-a9c7-fc13d48a25bb None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:11.651987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1171/2314] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:57:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:57:11.663423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b27ed-49f6-4afe-825b-57ebe152cd0b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:11.664572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b27ed-49f6-4afe-825b-57ebe152cd0b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:11.665203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b27ed-49f6-4afe-825b-57ebe152cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:11.725527 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-042b27ed-49f6-4afe-825b-57ebe152cd0b None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:11.727173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-042b27ed-49f6-4afe-825b-57ebe152cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:11.738406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1144/2315] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:11.751350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944e089-b430-42ac-a9c7-fc13d48a25bb None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:11.755034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9944e089-b430-42ac-a9c7-fc13d48a25bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:11.857219 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944e089-b430-42ac-a9c7-fc13d48a25bb None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:11.868691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6f3cd-a678-49f3-af54-c74ae64a3eba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:11.869420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f3cd-a678-49f3-af54-c74ae64a3eba service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:11.869709 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f3cd-a678-49f3-af54-c74ae64a3eba service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:11.870059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f3cd-a678-49f3-af54-c74ae64a3eba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:11.886535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6f3cd-a678-49f3-af54-c74ae64a3eba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:11.889580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6f3cd-a678-49f3-af54-c74ae64a3eba service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:11.902604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1172/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:11.993591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50de82-6b6c-43a6-bdda-c797cd0d215b None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:11.994104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50de82-6b6c-43a6-bdda-c797cd0d215b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:11.994391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50de82-6b6c-43a6-bdda-c797cd0d215b None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:11.995868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1145/2317] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:57:12.003351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a384-1ff1-4e27-b188-37bbc8d54bf0 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:12.003726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a384-1ff1-4e27-b188-37bbc8d54bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:12.004008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319a384-1ff1-4e27-b188-37bbc8d54bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:12.038008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f319a384-1ff1-4e27-b188-37bbc8d54bf0 None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:12.039248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f319a384-1ff1-4e27-b188-37bbc8d54bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:12.060830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1173/2318] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:12.074052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50de82-6b6c-43a6-bdda-c797cd0d215b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:12.086667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50de82-6b6c-43a6-bdda-c797cd0d215b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:12.092045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4190d-5456-4b5d-b9d5-995d754b5b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:12.093190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4190d-5456-4b5d-b9d5-995d754b5b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:12.093479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4190d-5456-4b5d-b9d5-995d754b5b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:12.093760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4190d-5456-4b5d-b9d5-995d754b5b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:12.102419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4190d-5456-4b5d-b9d5-995d754b5b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:12.104202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4190d-5456-4b5d-b9d5-995d754b5b9d service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:12.125201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1146/2319] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:57:12.206428 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebffbd-547c-465e-9011-82fbc45f5519 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:12.206807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebffbd-547c-465e-9011-82fbc45f5519 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:12.207026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebffbd-547c-465e-9011-82fbc45f5519 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:12.208416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1174/2320] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:57:12.216585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc6b6b-5223-47d6-8ddf-f414c9ec7afa None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:12.216879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc6b6b-5223-47d6-8ddf-f414c9ec7afa None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:12.217212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc6b6b-5223-47d6-8ddf-f414c9ec7afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:12.237845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c0cc6b6b-5223-47d6-8ddf-f414c9ec7afa None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:12.238989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c0cc6b6b-5223-47d6-8ddf-f414c9ec7afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:12.249991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1147/2321] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:57:12.263055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebffbd-547c-465e-9011-82fbc45f5519 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:12.275363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebffbd-547c-465e-9011-82fbc45f5519 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:12.282037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:12.282710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:12.282979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:12.283267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:12.295623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:12.296650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:12.308922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1175/2322] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:17.055171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1759-505c-4617-83d3-b5e5114f3bd3 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:17.055693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1759-505c-4617-83d3-b5e5114f3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:17.055778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed1759-505c-4617-83d3-b5e5114f3bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:17.074882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3aed1759-505c-4617-83d3-b5e5114f3bd3 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:17.076439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3aed1759-505c-4617-83d3-b5e5114f3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:17.092654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1148/2323] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:17.105395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:17.122408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de21d7e-7360-4ed8-b6f8-dcbb56d10d29 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:17.130434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:17.131449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:17.131924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:17.132385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:17.145951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:17.148442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:17.162688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1176/2324] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:57:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:57:21.681143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:21.681729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:21.681729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:21.688906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=74 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:21.718775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:21.733717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:21.761566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1149/2325] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 5 20:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:21.782224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:21.796772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b51bc8-642c-4a25-9ea5-4319cf476453 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:21.807436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:21.808260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:21.808685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:21.809137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:21.823437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:21.826077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:21.836325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1177/2326] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:57:23.986221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:23.987653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:24.098468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6dbf8-d496-4e6f-ae56-b3be72311210 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:24.103345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:24.104221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.105212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.105518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] PATH_INFO: `/v3/users/fd273630a84d41f49dcf8208c618f256` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.107562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd273630a84d41f49dcf8208c618f256)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:24.109643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:24.166975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd273630a84d41f49dcf8208c618f256'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.181216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd273630a84d41f49dcf8208c618f256'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.189370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd273630a84d41f49dcf8208c618f256'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.190096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd273630a84d41f49dcf8208c618f256'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.198770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ceae1529-2570-4b3d-98fe-c8dead6bfe40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd273630a84d41f49dcf8208c618f256'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.212441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1150/2327] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:57:23 2022] DELETE /identity/v3/users/fd273630a84d41f49dcf8208c618f256 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:57:24.428017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:24.440275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f109-031e-4ba7-8a5e-b12e42240bf7 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:24.550948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:24.552267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.552737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.553133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] PATH_INFO: `/v3/projects/a407f0bf436c4987b9eb2e59c46d82a9` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.554655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a407f0bf436c4987b9eb2e59c46d82a9)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:24.556618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:24.595455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:24.608642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a407f0bf436c4987b9eb2e59c46d82a9', 'request_id': 'req-06b85a17-ce51-4e56-ba07-80f86d73d5d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.614294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a407f0bf436c4987b9eb2e59c46d82a9', 'request_id': 'req-06b85a17-ce51-4e56-ba07-80f86d73d5d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.620630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a407f0bf436c4987b9eb2e59c46d82a9', 'request_id': 'req-06b85a17-ce51-4e56-ba07-80f86d73d5d8'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.634570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] The token cache is being invalidate because project a407f0bf436c4987b9eb2e59c46d82a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:57:24.634866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.635527 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-06b85a17-ce51-4e56-ba07-80f86d73d5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:24.637995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1178/2328] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:57:24 2022] DELETE /identity/v3/projects/a407f0bf436c4987b9eb2e59c46d82a9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:57:24.643490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.643780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.644085 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.698383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:24.699835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:24.720113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:24.766429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1151/2329] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:24.778239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.778807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.779300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.800682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:24.802078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:24.811679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1179/2330] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:57:24.816414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:24.827503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82132-5bfd-4c1f-b7bc-13b728965deb None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:24.833424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:24.834209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.834570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.834916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.835721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:57:24.836027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:24.837712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:24.850941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1152/2331] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:57:24.855461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:24.867915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836e228-f157-43c6-85f7-307535fe9921 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:24.874693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:24.875797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.875797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.876086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.876871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:24.878891 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:24.908975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1180/2332] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:57:24 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:57:24.910665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:24.921816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bc8b5-ef3f-413d-bb93-860594576553 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:24.984804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:24.985812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:24.986262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:24.987338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:24.988039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:24.990043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:25.011336 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1153/2333] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:57:24 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:57:25.016176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:25.026856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230711de-25ef-404c-b780-2aaddc38f4df admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:25.045077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:25.046253 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:25.046800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:25.047300 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:25.048676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:25.051821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:25.066760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1181/2334] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:57:25.070980 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:25.082589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08572b1f-7ba3-4035-aa3c-0f5146a464da admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:25.087625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d53082-c1f0-4989-a464-95b51f2f3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:25.088298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d53082-c1f0-4989-a464-95b51f2f3451 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:25.088583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d53082-c1f0-4989-a464-95b51f2f3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:25.088853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d53082-c1f0-4989-a464-95b51f2f3451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:25.089614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d53082-c1f0-4989-a464-95b51f2f3451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:25.091414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d53082-c1f0-4989-a464-95b51f2f3451 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:25.102787 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1154/2335] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:57:25.110016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:25.120550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f37c6-748d-4b80-af28-03dbb7eb7be0 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:25.126289 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:25.127138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:25.127452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:25.127729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] PATH_INFO: `/v3/projects/01c4943dddeb459fac6dcbf374fa25d2/users/2c12df8383044a28a7a562176236c482/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:25.144394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c4943dddeb459fac6dcbf374fa25d2, user_id=2c12df8383044a28a7a562176236c482, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:25.147264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:25.163001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1182/2336] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:57:25 2022] PUT /identity/v3/projects/01c4943dddeb459fac6dcbf374fa25d2/users/2c12df8383044a28a7a562176236c482/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:57:25.173004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:25.173296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:25.173547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:25.205934 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] MFA Rules not processed for user `2c12df8383044a28a7a562176236c482`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:25.207165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:25.276334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1155/2337] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:25.288368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:25.290320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:25.349751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d0efd-89b8-4295-a382-a3cb5ac69f37 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:25.353510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d68f47-3167-46d8-b92d-68e600b99b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:25.354157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d68f47-3167-46d8-b92d-68e600b99b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:25.354436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d68f47-3167-46d8-b92d-68e600b99b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:25.354710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d68f47-3167-46d8-b92d-68e600b99b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:25.364077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d68f47-3167-46d8-b92d-68e600b99b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:25.366095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d68f47-3167-46d8-b92d-68e600b99b18 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:25.376547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1183/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:28.060731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:28.081670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:28.124839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee1597-1112-43cf-90f5-bcd6db3385ac None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:28.129393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:28.130262 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.130560 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.130835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] PATH_INFO: `/v3/users/2c12df8383044a28a7a562176236c482` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.132017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c12df8383044a28a7a562176236c482)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:28.133968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:28.190358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c12df8383044a28a7a562176236c482'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.207220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c12df8383044a28a7a562176236c482'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.215506 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c12df8383044a28a7a562176236c482'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.216320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c12df8383044a28a7a562176236c482'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.224010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c12df8383044a28a7a562176236c482'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.233696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1156/2339] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:57:28 2022] DELETE /identity/v3/users/2c12df8383044a28a7a562176236c482 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:57:28.235257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.235823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.235924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.253835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:28.255073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:28.309824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:28.321792 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1184/2340] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:28.332512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:28.334235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:28.399341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b295-6d6d-4be3-b7b2-036324cfaafe admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:28.403774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a5200-b8bf-4590-afba-f20f6a803acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:28.404612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a5200-b8bf-4590-afba-f20f6a803acc service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.404903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a5200-b8bf-4590-afba-f20f6a803acc service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.405215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a5200-b8bf-4590-afba-f20f6a803acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.414293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a5200-b8bf-4590-afba-f20f6a803acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:28.415723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a5200-b8bf-4590-afba-f20f6a803acc service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:28.425451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1157/2341] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:57:28.716479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:28.718049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:28.729955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f6b4a-8bd2-4da8-a958-fc4fb3d280fa None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:28.734580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:28.735448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.735733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.736016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] PATH_INFO: `/v3/projects/01c4943dddeb459fac6dcbf374fa25d2` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.737250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c4943dddeb459fac6dcbf374fa25d2)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:28.739286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:28.794895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c4943dddeb459fac6dcbf374fa25d2', 'request_id': 'req-64f9fe42-7b35-4766-83ce-5aed57a8c095'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.800296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c4943dddeb459fac6dcbf374fa25d2', 'request_id': 'req-64f9fe42-7b35-4766-83ce-5aed57a8c095'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.806372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c4943dddeb459fac6dcbf374fa25d2', 'request_id': 'req-64f9fe42-7b35-4766-83ce-5aed57a8c095'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.819816 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] The token cache is being invalidate because project 01c4943dddeb459fac6dcbf374fa25d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:57:28.820101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.820715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-64f9fe42-7b35-4766-83ce-5aed57a8c095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:57:28.822277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1185/2342] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:57:28 2022] DELETE /identity/v3/projects/01c4943dddeb459fac6dcbf374fa25d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:57:28.827823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.828117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.828397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.847225 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:28.848368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:28.892602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:28.915664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1158/2343] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:28.923480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.923770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.924047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.943632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:28.944817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:28.953421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1186/2344] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:28.957368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:28.967164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b976af-de80-4719-9fc9-091d3320b75a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:28.971770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:28.972423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:28.972700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:28.973009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:28.973722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:57:28.974022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:28.975607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:28.987084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1159/2345] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:57:28.991306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:29.001303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046751-9012-4719-89f4-dcca5b4a73fa None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:29.005979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:29.006670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.006950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.007226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.007904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:29.009879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:29.035783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1187/2346] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:57:28 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:57:29.039837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:29.050110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fe433-194b-47ad-bd60-b097f86e9d22 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:29.105221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:29.106081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.106330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.106606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.107353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:29.109295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:29.128488 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1160/2347] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:57:29 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:57:29.132589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:29.143141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971891c-5f97-4267-a09a-9aa9a71f62d9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:29.147672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:29.148349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.148627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.149187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.149908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:29.151492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:29.162320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1188/2348] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:57:29.166025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:29.178458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1d07-2fcd-4c0e-b8e3-6fc8bace50b8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:29.183359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0cade-5f4a-4072-b5f6-55364ee94dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:29.184786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0cade-5f4a-4072-b5f6-55364ee94dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.185122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0cade-5f4a-4072-b5f6-55364ee94dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.185410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0cade-5f4a-4072-b5f6-55364ee94dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.186141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0cade-5f4a-4072-b5f6-55364ee94dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:29.187748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0cade-5f4a-4072-b5f6-55364ee94dcd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:29.197949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1161/2349] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:57:29.202111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:29.211943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68043dd2-4171-4e5e-9774-e38301584bb5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:29.216808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:29.217711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.217991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.218260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] PATH_INFO: `/v3/projects/a5a6d06a8e304f6ea73861124b7dbfb8/users/e521a311211d47c19b28f146a99e8a3a/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.233035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a6d06a8e304f6ea73861124b7dbfb8, user_id=e521a311211d47c19b28f146a99e8a3a, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:29.235673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:29.250356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1189/2350] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:57:29 2022] PUT /identity/v3/projects/a5a6d06a8e304f6ea73861124b7dbfb8/users/e521a311211d47c19b28f146a99e8a3a/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:57:29.261354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.261648 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.261937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.297594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] MFA Rules not processed for user `e521a311211d47c19b28f146a99e8a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:29.298859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:29.368290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1162/2351] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:29.380605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:29.382322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:29.486650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a048-5bfe-423c-9698-445c36fb6e75 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:29.490440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:29.491099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:29.491381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:29.491656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:29.502118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:29.504351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:29.515734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1190/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:31.389427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:31.391185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:31.438039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:31.455952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce1f8b-edae-4eb5-9e66-77947f6db06e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:31.459496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:31.460143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:31.460421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:31.460696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:31.462486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:31.528328 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:31.529812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb6f1c-f7f4-4c33-8286-938f722a379f service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:31.539380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1163/2353] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:31.824565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:31.826120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:31.830118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:31.928556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237ecc-3b65-4215-bfcc-b5ba6c3420a1 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:31.934264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:31.934906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:31.935187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:31.935462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:31.937283 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:31.949522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:31.951131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:31.961815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1191/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:41.535050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=33 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:41.957595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=40 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:44.750962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:44.751684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:44.751684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:44.810326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:44.811890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:44.893385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1164/2355] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 5 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:44.907655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:44.909134 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:45.005765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bd49a-5eec-42f4-902c-32bba2db848f service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:45.011522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecbfaa-9cfe-41e4-ac00-3dcd32c40e4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:45.012186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecbfaa-9cfe-41e4-ac00-3dcd32c40e4a service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:45.012469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecbfaa-9cfe-41e4-ac00-3dcd32c40e4a service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:45.012739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecbfaa-9cfe-41e4-ac00-3dcd32c40e4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:45.021008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecbfaa-9cfe-41e4-ac00-3dcd32c40e4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:45.022582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecbfaa-9cfe-41e4-ac00-3dcd32c40e4a service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:45.031532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1192/2356] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:57:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:57:54.890013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=40 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:55.028320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=41 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:07.745629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:07.812668 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9519-8902-403a-9230-21cdaadbbe6e None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:07.817287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:07.818186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:07.818465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:07.818736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] PATH_INFO: `/v3/users/e521a311211d47c19b28f146a99e8a3a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:07.819906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e521a311211d47c19b28f146a99e8a3a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:07.821861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:07.867992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e521a311211d47c19b28f146a99e8a3a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:07.880828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e521a311211d47c19b28f146a99e8a3a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:07.889316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e521a311211d47c19b28f146a99e8a3a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:07.890033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e521a311211d47c19b28f146a99e8a3a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:07.897785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e521a311211d47c19b28f146a99e8a3a'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:07.904136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1165/2357] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:07 2022] DELETE /identity/v3/users/e521a311211d47c19b28f146a99e8a3a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:07.908471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:07.909019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:07.909133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:07.926106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:07.927487 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:07.984983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1193/2358] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:07.995402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:07.996854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:08.054744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fca4fb-cc7c-4037-85b7-6f2529bbedbd admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.058954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22f75-4ac6-463f-805e-9c6ee3e6e7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.059591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22f75-4ac6-463f-805e-9c6ee3e6e7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.059874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22f75-4ac6-463f-805e-9c6ee3e6e7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.060149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22f75-4ac6-463f-805e-9c6ee3e6e7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.069135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22f75-4ac6-463f-805e-9c6ee3e6e7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.070571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22f75-4ac6-463f-805e-9c6ee3e6e7d1 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.080740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1166/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:08.349510 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.350931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:08.363886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51635b5-e563-4ca5-aed5-aeffa819bc07 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.368536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.369991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.370279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.370600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] PATH_INFO: `/v3/projects/a5a6d06a8e304f6ea73861124b7dbfb8` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.372364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a6d06a8e304f6ea73861124b7dbfb8)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.373835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.420026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a6d06a8e304f6ea73861124b7dbfb8', 'request_id': 'req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:08.425472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a6d06a8e304f6ea73861124b7dbfb8', 'request_id': 'req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:08.433024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a6d06a8e304f6ea73861124b7dbfb8', 'request_id': 'req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:08.445177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] The token cache is being invalidate because project a5a6d06a8e304f6ea73861124b7dbfb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:08.445474 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:08.446101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cb436b5d-ef29-4bda-bbb3-c87d24e7a5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:08.447706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1194/2360] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:08 2022] DELETE /identity/v3/projects/a5a6d06a8e304f6ea73861124b7dbfb8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:08.452672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.452992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.453277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.471250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:08.472466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:08.491404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:08.537804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1167/2361] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:58:08.546156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.546445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.546723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.566008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:08.567189 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:08.576363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1195/2362] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:08.580493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.590798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f63a47-55e1-43cf-aa34-888b35484de4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.595355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.596201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.596306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.596687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.597443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:58:08.597752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.599377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.611867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1168/2363] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:58:08.615993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.625236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a37562-0779-4b47-bb95-f89d437caba6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.629997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.630639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.630918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.631187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.631871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.633827 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.662390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1196/2364] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:08 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:58:08.666524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.676496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0277-239e-4ae6-90ce-efc23a12f5b6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.731814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.732411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.732699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.733002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.733679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.735594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.757205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1169/2365] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:08 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:08.761892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.772374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57997c8d-1aa9-43ab-9ff9-5e85788bcd2c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.777445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.778110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.778396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.778681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.779416 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.781056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.791566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1197/2366] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:58:08.795571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.805525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9686cf-223d-452d-a81c-134e9efb8eea admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.810631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab127d-274a-484e-a704-5621e7b8a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.811285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab127d-274a-484e-a704-5621e7b8a7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.811568 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab127d-274a-484e-a704-5621e7b8a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.811846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab127d-274a-484e-a704-5621e7b8a7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.812564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab127d-274a-484e-a704-5621e7b8a7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.814277 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab127d-274a-484e-a704-5621e7b8a7ac admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.824890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1170/2367] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:08.828893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:08.839462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb005-a599-4165-97f8-106f8b9d5c62 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:08.844692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:08.845585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.845868 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.846145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] PATH_INFO: `/v3/projects/1c1e0ce78ee54a5b9a2faaeb22d86bcb/users/30bb54108aff47219806b28dd9839192/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.861213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e0ce78ee54a5b9a2faaeb22d86bcb, user_id=30bb54108aff47219806b28dd9839192, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:08.864152 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:08.877733 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1198/2368] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:08 2022] PUT /identity/v3/projects/1c1e0ce78ee54a5b9a2faaeb22d86bcb/users/30bb54108aff47219806b28dd9839192/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:08.944986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18578-69f4-4c40-bc88-7d5903ee7ea5 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:08.945313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18578-69f4-4c40-bc88-7d5903ee7ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:08.945595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d18578-69f4-4c40-bc88-7d5903ee7ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:08.973734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-90d18578-69f4-4c40-bc88-7d5903ee7ea5 None None] MFA Rules not processed for user `30bb54108aff47219806b28dd9839192`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:08.974956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-90d18578-69f4-4c40-bc88-7d5903ee7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:09.039059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1171/2369] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:09.050171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:09.051933 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:09.074178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:09.115198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f431387-d52d-4d78-9773-37adbc2fdce6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:09.120355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:09.121507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:09.121890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:09.122140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:09.130764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:09.132195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:09.141156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1199/2370] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:19.036209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:19.137140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=17 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:21.927582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494493c-12d7-4357-93e9-f5a0747e191d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:21.928127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494493c-12d7-4357-93e9-f5a0747e191d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:21.928127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494493c-12d7-4357-93e9-f5a0747e191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:21.945812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d494493c-12d7-4357-93e9-f5a0747e191d None None] MFA Rules not processed for user `d152763a64794301b21587ab2b395bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:21.947999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d494493c-12d7-4357-93e9-f5a0747e191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:22.005959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1172/2371] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:27.389707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:27.454488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41768502-33cb-432f-9135-f1028884b0db service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:27.459051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:27.459931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:27.460213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:27.460493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] PATH_INFO: `/v3/users/30bb54108aff47219806b28dd9839192` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:27.461715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bb54108aff47219806b28dd9839192)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:27.463646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:27.516192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bb54108aff47219806b28dd9839192'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:27.529347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bb54108aff47219806b28dd9839192'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:27.536308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bb54108aff47219806b28dd9839192'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:27.537129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bb54108aff47219806b28dd9839192'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:27.546135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bb54108aff47219806b28dd9839192'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:27.552612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1200/2372] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:27 2022] DELETE /identity/v3/users/30bb54108aff47219806b28dd9839192 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:27.557252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:27.557729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:27.557885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:27.576691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:27.577929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:27.637762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1173/2373] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:58:27.647311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:27.649001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:27.711840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28b77-4340-4eaf-90fc-16c9bfcdb95b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:27.718336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89388-d4ac-4d67-9c14-6ba2e2363524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:27.719000 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89388-d4ac-4d67-9c14-6ba2e2363524 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:27.719280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89388-d4ac-4d67-9c14-6ba2e2363524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:27.719550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89388-d4ac-4d67-9c14-6ba2e2363524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:27.729802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89388-d4ac-4d67-9c14-6ba2e2363524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:27.732923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89388-d4ac-4d67-9c14-6ba2e2363524 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:27.742864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1201/2374] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:28.032294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:28.033784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:28.052241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bc468-7c81-4504-b178-0b8ac29021fb None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:28.058283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:28.059945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:28.060416 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:28.060880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] PATH_INFO: `/v3/projects/1c1e0ce78ee54a5b9a2faaeb22d86bcb` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:28.063000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1e0ce78ee54a5b9a2faaeb22d86bcb)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:28.065724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:28.114777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1e0ce78ee54a5b9a2faaeb22d86bcb', 'request_id': 'req-223718d3-5410-4497-a846-7442d2d262ae'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:28.121409 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1e0ce78ee54a5b9a2faaeb22d86bcb', 'request_id': 'req-223718d3-5410-4497-a846-7442d2d262ae'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:28.128792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1e0ce78ee54a5b9a2faaeb22d86bcb', 'request_id': 'req-223718d3-5410-4497-a846-7442d2d262ae'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:28.141244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] The token cache is being invalidate because project 1c1e0ce78ee54a5b9a2faaeb22d86bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:28.141456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:28.142093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-223718d3-5410-4497-a846-7442d2d262ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:28.143946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1174/2375] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:28 2022] DELETE /identity/v3/projects/1c1e0ce78ee54a5b9a2faaeb22d86bcb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:37.738268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:38.136796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:43.072784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:43.073367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:43.073483 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:43.091072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] MFA Rules not processed for user `a3792881ae73408db651dd6eb09b3d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:43.092251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:43.146500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1202/2376] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:53.139818 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=25 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:09.135831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:09.136380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:09.136470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:09.155449 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] MFA Rules not processed for user `5eac41ce3f04450b840cff305ec1a5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:09.156710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:09.211861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1175/2377] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:59:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:16.893290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:16.894731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:16.964188 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32840c-5752-4131-b6c1-b5cbcf305dc6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:16.968554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:16.969332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:16.970052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:16.970052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:16.972641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:16.992535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:17.002435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df91f1-fbe9-480d-a76e-fa6dc39c99d5 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:17.006783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:17.007601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:17.008052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:17.008323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:17.011117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:17.080981 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:17.082544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1417c-7e75-4d5e-b510-69d3a0a23691 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:17.088106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:17.089672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bec143-f4cd-475a-b60e-fb0b5627e222 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:17.105770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1203/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:17.110961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1176/2379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:59:27.102102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=63 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:27.108071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=63 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:28.265555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b2bd-d833-4b1b-b692-afda554331e8 None None] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.266123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b2bd-d833-4b1b-b692-afda554331e8 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.266257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b2bd-d833-4b1b-b692-afda554331e8 None None] PATH_INFO: `/` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.268165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1204/2380] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:59:28.276405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d412-ef25-45f5-b6fa-ac04ea85e76e None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.277012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d412-ef25-45f5-b6fa-ac04ea85e76e None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.277012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d412-ef25-45f5-b6fa-ac04ea85e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.297733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-6120d412-ef25-45f5-b6fa-ac04ea85e76e None None] MFA Rules not processed for user `39aef7668f15405b8d665fe61e6a49c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:28.298976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6120d412-ef25-45f5-b6fa-ac04ea85e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:28.313630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1177/2381] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:28.322986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33b2bd-d833-4b1b-b692-afda554331e8 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:28.325357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-db33b2bd-d833-4b1b-b692-afda554331e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:28.347329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33b2bd-d833-4b1b-b692-afda554331e8 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:28.351220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3d90e-cae0-4bd5-b514-ae8b6090e9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:28.352541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d90e-cae0-4bd5-b514-ae8b6090e9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.353181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d90e-cae0-4bd5-b514-ae8b6090e9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.353495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3d90e-cae0-4bd5-b514-ae8b6090e9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.362485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3d90e-cae0-4bd5-b514-ae8b6090e9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:28.364036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3d90e-cae0-4bd5-b514-ae8b6090e9b5 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:28.373028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1205/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:28.459452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea1d4-e710-4a63-8686-9b70a1985fe4 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.459767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea1d4-e710-4a63-8686-9b70a1985fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.460050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea1d4-e710-4a63-8686-9b70a1985fe4 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.462129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1178/2383] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 20:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:59:28.467391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.467713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.467998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.505883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:28.507079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:28.517720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1206/2384] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:28.529727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ea1d4-e710-4a63-8686-9b70a1985fe4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:28.541493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ea1d4-e710-4a63-8686-9b70a1985fe4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:28.545199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:28.545844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.546207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.546380 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.558752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:28.561184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:28.574150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1179/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:28.645090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:28.647174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:28.778418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f6af-8dcb-4173-9771-6b3a8d1a97e6 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:28.784010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:28.784817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:28.785048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:28.785382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:28.787382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:28.800039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:28.801757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:28.814632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1207/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:29.857912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:29.867268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709218f-1927-40a4-bafc-aad6c598b6d6 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:29.871761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:29.872526 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:29.872814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:29.873130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:29.874902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:29.937006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:29.938370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:29.948613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1180/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:33.314235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.315831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.332491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef9188-a278-40b3-a03f-482787a24d0f service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.344335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.345459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.345873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.346254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] PATH_INFO: `/v3/users/d152763a64794301b21587ab2b395bbf` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.347666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d152763a64794301b21587ab2b395bbf)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.349855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.426322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd152763a64794301b21587ab2b395bbf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.442696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd152763a64794301b21587ab2b395bbf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.451030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd152763a64794301b21587ab2b395bbf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.451800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd152763a64794301b21587ab2b395bbf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.460601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-eee3aa95-8073-40e9-a165-9f635622f888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd152763a64794301b21587ab2b395bbf'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.467514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1208/2388] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:33 2022] DELETE /identity/v3/users/d152763a64794301b21587ab2b395bbf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:33.647727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.664792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c47f-f471-41d6-9669-1701d601f659 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.728158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.728970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.729259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.729535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] PATH_INFO: `/v3/projects/fc6d47f96d17471d94367bc8f8a3e3f6` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.730713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6d47f96d17471d94367bc8f8a3e3f6)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.732672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.780444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'request_id': 'req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.786220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'request_id': 'req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.794783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6d47f96d17471d94367bc8f8a3e3f6', 'request_id': 'req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.807158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] The token cache is being invalidate because project fc6d47f96d17471d94367bc8f8a3e3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:33.807446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.808074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f6716076-29e7-4cc3-9bfd-6a6b3a7932c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.809642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1181/2389] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:33 2022] DELETE /identity/v3/projects/fc6d47f96d17471d94367bc8f8a3e3f6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:33.814493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.814809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.815138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.836622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:33.837897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.862543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:33.904564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1209/2390] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:33.912222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.912517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.912802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.920145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:33.932315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:33.933893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.941888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1182/2391] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:33.946763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.956619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53136974-6df0-4166-aa3b-9e42a0779d7b None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.961198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.961841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.962119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.962392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.963110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:59:33.963409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.965154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.976501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1210/2392] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 20:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:59:33.980795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.990181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fdf7c-f176-43c5-b178-5293dbd02c49 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.995388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.996037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.996320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.996593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.997309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.999214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.024720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1183/2393] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:34.028883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.038850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91b1e0-5543-4d00-818c-674d197dfab2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.094405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.095085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.095356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.095633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.096314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.098272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.117977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1211/2394] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:34 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:34.122257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.132575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f4135-4f91-4398-bb1e-237ef556e122 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.138080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.138765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.139051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.139342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.140049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.141696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.152707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1184/2395] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:34.156640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.166633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4673d52-0bf3-40ae-aaaa-51b8a91b88d3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.171275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfe643-3db6-4106-ba81-ea6127327ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.171921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfe643-3db6-4106-ba81-ea6127327ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.172199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfe643-3db6-4106-ba81-ea6127327ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.172473 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfe643-3db6-4106-ba81-ea6127327ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.173221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfe643-3db6-4106-ba81-ea6127327ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.174805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfe643-3db6-4106-ba81-ea6127327ca9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.185121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1212/2396] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:34.189147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.199710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d3dcf-b2dd-48d3-b6fb-8dea95a20fca admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.204337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.205237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.205518 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.205791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] PATH_INFO: `/v3/projects/eefc27e7b64746668ae28f2518281686/users/b5106bd902f349adb1779faa67ec8117/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.220398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefc27e7b64746668ae28f2518281686, user_id=b5106bd902f349adb1779faa67ec8117, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.223077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.236659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1185/2397] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:34 2022] PUT /identity/v3/projects/eefc27e7b64746668ae28f2518281686/users/b5106bd902f349adb1779faa67ec8117/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:34.248422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.248713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.249122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.275875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] MFA Rules not processed for user `b5106bd902f349adb1779faa67ec8117`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:34.277135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:34.340788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1213/2398] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:34.345274 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.409233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9f4f-964e-42f3-8cf8-f8ef2da7bb75 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.415139 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.415815 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.416096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.416434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.417079 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.419002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.450071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1186/2399] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:34 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:34.451240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.462167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c7886-569f-4de7-9dc6-66c9ca9fbd5c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.482348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:34.523568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.524519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.524808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.525121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.525814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.527732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.554129 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1214/2400] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:34 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:34.555590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.567535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e162e-884b-4324-8354-1144ea8b12c1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.577138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.577834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.578111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.578383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.579103 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.580712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.595180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1187/2401] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:34.599583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.610454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d9a0-e0d0-4189-8856-04e073724534 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.616753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.618420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.618767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.619123 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] PATH_INFO: `/v3/projects/ca3708d81fbf49d5a25ea47a9fea644f/users/9a57858c28604702b4ba8330cba3b54a/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.638172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3708d81fbf49d5a25ea47a9fea644f, user_id=9a57858c28604702b4ba8330cba3b54a, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.641029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.656156 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1215/2402] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:34 2022] PUT /identity/v3/projects/ca3708d81fbf49d5a25ea47a9fea644f/users/9a57858c28604702b4ba8330cba3b54a/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:59:34.660112 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.672231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a314b-a821-43ea-9bcc-3e565eeefafb admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.732339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e5be1-e3b2-41af-9ed1-51b68ade0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.733037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e5be1-e3b2-41af-9ed1-51b68ade0665 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.733323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e5be1-e3b2-41af-9ed1-51b68ade0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.733597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e5be1-e3b2-41af-9ed1-51b68ade0665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.734313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e5be1-e3b2-41af-9ed1-51b68ade0665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.735922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e5be1-e3b2-41af-9ed1-51b68ade0665 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.745904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1188/2403] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:34.750196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.760603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5ac8-1a1a-4025-a26d-b20177ad63d6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.765478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.766344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.766573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.766850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] PATH_INFO: `/v3/projects/ca3708d81fbf49d5a25ea47a9fea644f/users/9a57858c28604702b4ba8330cba3b54a/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.768881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3708d81fbf49d5a25ea47a9fea644f, user_id=9a57858c28604702b4ba8330cba3b54a, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.771833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.783430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1216/2404] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:34 2022] PUT /identity/v3/projects/ca3708d81fbf49d5a25ea47a9fea644f/users/9a57858c28604702b4ba8330cba3b54a/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:34.794002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.794320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.794601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.814630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:34.822748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] MFA Rules not processed for user `9a57858c28604702b4ba8330cba3b54a`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:34.824151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:34.895370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1189/2405] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:34.907103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.908804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:34.970104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f6b44-8f2d-4aaf-aab6-b0cc05415300 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.973972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.974622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.974904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.975231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:35.032615 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:35.034031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:35.043644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1217/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:39.652167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:39.661677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55971b6-5d6d-4442-8d3e-f3d310ab4d8b None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:39.665569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:39.666247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:39.666530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:39.666805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:39.676211 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:39.677679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:39.687763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1190/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:45.039066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:47.724080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:47.725548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:47.784536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9769-0ab6-41da-97d6-61616888689a service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:47.788105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:47.788893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:47.789319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:47.789597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:47.791411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:47.801645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:47.803111 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02154c-be5b-4982-967a-7f284f10cf07 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:47.812619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1218/2408] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:47.817040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:47.818445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:47.896403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfee01-b40e-4008-9b3b-253c5096d9d9 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:47.902606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:47.903265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:47.903546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:47.903822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:47.905639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:47.963867 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:47.965535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:47.974461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1191/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:59:55.670504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:55.670920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:55.671118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:55.689866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:55.691071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:55.757700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1219/2410] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:55.817774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:55.820501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:55.847888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:55.910427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea869fd-2672-4ec9-a9d6-2e302d071d9c service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:55.915468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:55.916111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:55.916491 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:55.917041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:55.929153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:55.930775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:55.939565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1192/2411] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 20:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:59:59.155209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:59.170777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9c42a-d3af-41a9-a5a3-b45d106c88a5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:59.182352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:59.183058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:59.183399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:59.183729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:59.185770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:59.203246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:59.204886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:59.221029 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1220/2412] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:03.234704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:03.253754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82230-049e-4ca2-9379-5d7041a7e6b4 service swift] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:03.271066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:03.276611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:03.277480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:03.278135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:03.288309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:03.304160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:03.305996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67431b34-4b86-45ad-a399-8c5e7dcf5877 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:03.322547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1193/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:03.928633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:04.028047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff77e8-cfb7-4320-b45c-9d5cea40797f service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:04.032784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:04.033708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:04.033982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:04.034444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] PATH_INFO: `/v3/users/b5106bd902f349adb1779faa67ec8117` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:04.035659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5106bd902f349adb1779faa67ec8117)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:04.038328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:04.105455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:04.134665 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5106bd902f349adb1779faa67ec8117'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.155181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5106bd902f349adb1779faa67ec8117'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.172625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5106bd902f349adb1779faa67ec8117'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.173772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5106bd902f349adb1779faa67ec8117'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.193169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5106bd902f349adb1779faa67ec8117'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.206853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:04.207294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:04.207643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:04.210161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1221/2414] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:03 2022] DELETE /identity/v3/users/b5106bd902f349adb1779faa67ec8117 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:04.226583 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:04.227915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:04.301931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1194/2415] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:04.312774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:04.314234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:04.388914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48445-53ca-4433-9f0b-456118b1568d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:04.393063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:04.393718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:04.394001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:04.394280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:04.409325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:04.410971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:04.427105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1222/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:04.813653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:04.815424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:04.834684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce7868-de01-4840-a846-1aa3a86bb71c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:04.840166 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:04.841375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:04.841878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:04.842383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] PATH_INFO: `/v3/projects/eefc27e7b64746668ae28f2518281686` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:04.844830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefc27e7b64746668ae28f2518281686)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:04.847482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:04.908100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefc27e7b64746668ae28f2518281686', 'request_id': 'req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.914182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefc27e7b64746668ae28f2518281686', 'request_id': 'req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.933665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefc27e7b64746668ae28f2518281686', 'request_id': 'req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.958676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] The token cache is being invalidate because project eefc27e7b64746668ae28f2518281686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:04.958676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.958676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-557bfdd4-3436-4f4c-8f7f-11aa2d13b7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:04.960284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1195/2417] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:04 2022] DELETE /identity/v3/projects/eefc27e7b64746668ae28f2518281686 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:04.964104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:04.992838 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fae2f-78ee-4d8b-bd69-23c10d2024e5 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:05.031255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:05.031540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:05.032084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:05.060894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] MFA Rules not processed for user `261feb03a8ff459b8874232bec05034f`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:05.062609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:05.089294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:05.108117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:05.109468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:05.109924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:05.110419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] PATH_INFO: `/v3/users/9a57858c28604702b4ba8330cba3b54a` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:05.112835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a57858c28604702b4ba8330cba3b54a)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:05.116800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:05.177011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1196/2418] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:05.217007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a57858c28604702b4ba8330cba3b54a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:05.231927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:05.238528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a57858c28604702b4ba8330cba3b54a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:05.253635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a57858c28604702b4ba8330cba3b54a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:05.254461 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a57858c28604702b4ba8330cba3b54a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:05.275616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a57858c28604702b4ba8330cba3b54a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:05.289887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1223/2419] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:04 2022] DELETE /identity/v3/users/9a57858c28604702b4ba8330cba3b54a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:05.883110 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:05.884716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:05.947367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:05.948906 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:05.950093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802f246-c8cc-4bd7-8f18-471ea64eda14 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.007960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.008625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.008909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.009227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.011023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:06.020827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.022451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba464923-513f-4e73-87db-0f0bcabd5554 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.029585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a037-c923-45f6-9374-144516ee7900 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.030512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1197/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:06.034740 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.035607 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.035904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.036168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] PATH_INFO: `/v3/projects/ca3708d81fbf49d5a25ea47a9fea644f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.038091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3708d81fbf49d5a25ea47a9fea644f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.040021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.087400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3708d81fbf49d5a25ea47a9fea644f', 'request_id': 'req-9b907353-fa5c-48aa-b8d9-8cf55cec091e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:06.093254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3708d81fbf49d5a25ea47a9fea644f', 'request_id': 'req-9b907353-fa5c-48aa-b8d9-8cf55cec091e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:06.101323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3708d81fbf49d5a25ea47a9fea644f', 'request_id': 'req-9b907353-fa5c-48aa-b8d9-8cf55cec091e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:06.115960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] The token cache is being invalidate because project ca3708d81fbf49d5a25ea47a9fea644f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:06.116291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:06.116966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-9b907353-fa5c-48aa-b8d9-8cf55cec091e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:06.118830 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1224/2421] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:05 2022] DELETE /identity/v3/projects/ca3708d81fbf49d5a25ea47a9fea644f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:00:06.126216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.126575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.126860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.148594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:06.150916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:06.251077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1198/2422] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:06.260126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.260452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.260700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.281903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:06.283155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:06.295760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1225/2423] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:06.296814 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.308887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3242f11-778f-456e-a116-81cc49434a32 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.314544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.315463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.315760 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.316172 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.317078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:00:06.317447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.319734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.336696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1199/2424] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:00:06.337936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.349382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79dd0-992a-4a34-afd3-a0ac001bdf55 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.374344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.375027 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.375315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.375594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.376290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.378411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.411695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1226/2425] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:06.416111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.428732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f9f7e-75bc-49b7-a1c5-800b68440c7b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.437357 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:06.520523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.521477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.523439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.523811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.524880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.527665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.552480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1200/2426] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:00:06.556492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.569324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54171ed9-cb85-483a-b576-00c4f8bd3d99 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.575025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.575788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.576332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.576456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.577384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.579179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.602579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1227/2427] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:06.606571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.618836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992a95-fc4c-403f-bd71-e700aff17c75 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.624819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5789-8aac-49f3-a04d-30f05d22911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.625534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5789-8aac-49f3-a04d-30f05d22911a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.625820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5789-8aac-49f3-a04d-30f05d22911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.626147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5789-8aac-49f3-a04d-30f05d22911a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.626832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5789-8aac-49f3-a04d-30f05d22911a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.631075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5789-8aac-49f3-a04d-30f05d22911a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.642289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1201/2428] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:00:06.646930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.657840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08c451-bbbe-46e2-9f83-73dc41e3b4e3 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.663167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.664128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.664405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.664676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] PATH_INFO: `/v3/projects/62996cc52f424339bbe3eba0f6ccb081/users/34caa01bf4754a6fa4103ff7b2b4b778/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.682642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62996cc52f424339bbe3eba0f6ccb081, user_id=34caa01bf4754a6fa4103ff7b2b4b778, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.685499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.701069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1228/2429] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:06 2022] PUT /identity/v3/projects/62996cc52f424339bbe3eba0f6ccb081/users/34caa01bf4754a6fa4103ff7b2b4b778/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:06.711485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.711795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.712068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.742805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] MFA Rules not processed for user `34caa01bf4754a6fa4103ff7b2b4b778`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:06.743976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:06.836004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1202/2430] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:06.840480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.845425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:06.916200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a20b-4e56-453e-bd2d-5980d42c93b7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:06.920831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:06.921699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:06.921984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:06.922257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:06.922955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:06.924856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:06.954486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1229/2431] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:06.958644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:06.971235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f6f3a-f8f3-4e3d-9fb9-f3f77f0e4ba4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.042937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.043623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.043907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.044184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.044884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.046837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.066811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1203/2432] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:06 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:00:07.071516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.081831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaa7c6-3f3f-4ad7-8484-890508e3aa56 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.086554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.087212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.087488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.087770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.088494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.090139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.101078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1230/2433] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:07.105252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.115209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d424894-1206-4743-a899-8154a0885437 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.120664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.121581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.121858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.122130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] PATH_INFO: `/v3/projects/8495abb5aab8405f818d9b720301e437/users/583f060b30f04ef889d6381d310f05c9/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.125287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:07.140511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8495abb5aab8405f818d9b720301e437, user_id=583f060b30f04ef889d6381d310f05c9, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.143195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.156236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1204/2434] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:07 2022] PUT /identity/v3/projects/8495abb5aab8405f818d9b720301e437/users/583f060b30f04ef889d6381d310f05c9/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:07.160236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.170415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b693d-cd2e-43bb-b913-d5961ab7cc1a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.227939 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd8a35-f1d4-4b2a-a350-f7dab75ce5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.228601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd8a35-f1d4-4b2a-a350-f7dab75ce5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.228885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd8a35-f1d4-4b2a-a350-f7dab75ce5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.229191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd8a35-f1d4-4b2a-a350-f7dab75ce5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.229907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd8a35-f1d4-4b2a-a350-f7dab75ce5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.231501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd8a35-f1d4-4b2a-a350-f7dab75ce5d8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.241647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1231/2435] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:07.245771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.255948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd97a1c-9769-4d9c-b83b-1c131c363977 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.261122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.261986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.262263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.262531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] PATH_INFO: `/v3/projects/8495abb5aab8405f818d9b720301e437/users/583f060b30f04ef889d6381d310f05c9/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.264466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8495abb5aab8405f818d9b720301e437, user_id=583f060b30f04ef889d6381d310f05c9, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.267126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.277366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1205/2436] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:07 2022] PUT /identity/v3/projects/8495abb5aab8405f818d9b720301e437/users/583f060b30f04ef889d6381d310f05c9/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:07.287265 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.287555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.287867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.314375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] MFA Rules not processed for user `583f060b30f04ef889d6381d310f05c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:07.315580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:07.378915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:07.385395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1232/2437] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:07.399157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.400862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:07.465942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c33e8-2bad-44d8-9cb8-9c807b990810 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.469592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.470360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.470645 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.471384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.481710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.483171 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.494007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1206/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:07.539916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.545894 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:07.554259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c87c-6fd9-454a-bf7f-26277d66aa13 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.557983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.558686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.558970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.559718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.617351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:07.618864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:07.628342 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1233/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:10.966909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:10.969997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:11.071136 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9819bdb-4948-4435-a767-89af7e513cdd service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:11.077834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:11.078460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:11.079101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.079388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.079821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.081721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:11.099793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:11.102297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a696a4b-2b5f-4e76-ba79-7c91831a38ef service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:11.114575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1207/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:11.186351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba90000-3cf9-4369-bc51-eba70115bbe2 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:11.192292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:11.194693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.195362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.196116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] PATH_INFO: `/v3/users/34caa01bf4754a6fa4103ff7b2b4b778` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.197744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34caa01bf4754a6fa4103ff7b2b4b778)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:11.200244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:11.305176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb314-bba1-4cb4-a35e-ae8cec8e8f90 None None] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.305582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb314-bba1-4cb4-a35e-ae8cec8e8f90 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.305946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcb314-bba1-4cb4-a35e-ae8cec8e8f90 None None] PATH_INFO: `/` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.307954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1208/2441] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 5 21:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 21:00:11.314019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.314561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.315068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.322024 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34caa01bf4754a6fa4103ff7b2b4b778'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:11.337719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] MFA Rules not processed for user `624366e88245426a8837e3ce0b714531`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:11.338876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:11.364347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34caa01bf4754a6fa4103ff7b2b4b778'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:11.372871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34caa01bf4754a6fa4103ff7b2b4b778'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:11.374263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34caa01bf4754a6fa4103ff7b2b4b778'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:11.387149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-dae772fd-6d60-451a-b143-954775b27af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34caa01bf4754a6fa4103ff7b2b4b778'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:11.398929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1234/2442] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:11 2022] DELETE /identity/v3/users/34caa01bf4754a6fa4103ff7b2b4b778 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:11.402174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.402174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.404161 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.425779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:11.427263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:11.442171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:11.453265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1209/2443] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 5 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:11.467021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:11.468808 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:11.486168 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:11.519364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1235/2444] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:11.533452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:11.535109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:11.583187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab991c0-80dd-4c1c-ac1a-79437e77fe10 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:11.626534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a582f-a3c4-4bf1-8ee7-2b7c3cdd84a4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:11.641508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:11.642212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.642502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.642787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.664446 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:11.665279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:11.665564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:11.665839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:11.668820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:11.670934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:11.686028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1236/2445] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:00:11.783278 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:11.785125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:11.800649 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1210/2446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:12.148242 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:12.150248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:12.168149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8e51-786d-4cbc-9144-8450f1542289 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:12.182850 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:12.183960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:12.184494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:12.184782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] PATH_INFO: `/v3/projects/62996cc52f424339bbe3eba0f6ccb081` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:12.186612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62996cc52f424339bbe3eba0f6ccb081)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:12.188526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:12.252075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62996cc52f424339bbe3eba0f6ccb081', 'request_id': 'req-0a02266b-702c-4459-921a-71b48f909ce2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.259064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62996cc52f424339bbe3eba0f6ccb081', 'request_id': 'req-0a02266b-702c-4459-921a-71b48f909ce2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.265614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62996cc52f424339bbe3eba0f6ccb081', 'request_id': 'req-0a02266b-702c-4459-921a-71b48f909ce2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.282197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] The token cache is being invalidate because project 62996cc52f424339bbe3eba0f6ccb081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:12.282443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.283773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.285176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1237/2447] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:12 2022] DELETE /identity/v3/projects/62996cc52f424339bbe3eba0f6ccb081 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:12.290158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:12.301440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e5f4a-a5c2-49b0-969a-ccad4ad1249d service glance] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:12.360320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:12.374505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:12.375493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:12.375962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:12.376327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] PATH_INFO: `/v3/users/583f060b30f04ef889d6381d310f05c9` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:12.377750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583f060b30f04ef889d6381d310f05c9)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:12.379693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:12.430598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583f060b30f04ef889d6381d310f05c9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.442959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583f060b30f04ef889d6381d310f05c9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.450758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583f060b30f04ef889d6381d310f05c9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.451540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583f060b30f04ef889d6381d310f05c9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.461654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ec3e60c-004b-4d56-bd33-d7097777b089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583f060b30f04ef889d6381d310f05c9'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:12.468383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1211/2448] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:12 2022] DELETE /identity/v3/users/583f060b30f04ef889d6381d310f05c9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:12.966090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:12.967534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:12.984072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02266b-702c-4459-921a-71b48f909ce2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.028261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:13.046218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.047079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.047356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.047624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] PATH_INFO: `/v3/projects/8495abb5aab8405f818d9b720301e437` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.048785 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8495abb5aab8405f818d9b720301e437)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.050786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.096371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8495abb5aab8405f818d9b720301e437', 'request_id': 'req-cbd7f3c9-5be2-4fed-8469-b3352f24864f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:13.102077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8495abb5aab8405f818d9b720301e437', 'request_id': 'req-cbd7f3c9-5be2-4fed-8469-b3352f24864f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:13.108377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8495abb5aab8405f818d9b720301e437', 'request_id': 'req-cbd7f3c9-5be2-4fed-8469-b3352f24864f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:13.124133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] The token cache is being invalidate because project 8495abb5aab8405f818d9b720301e437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:13.124422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:13.125198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-cbd7f3c9-5be2-4fed-8469-b3352f24864f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:13.126728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1238/2449] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:12 2022] DELETE /identity/v3/projects/8495abb5aab8405f818d9b720301e437 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:13.132720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.133056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.133358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.152710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:13.153975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:13.220615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1212/2450] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:13.228808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.230199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.230674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.252226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:13.253786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:13.262526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1239/2451] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:13.266742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.277470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5ecfb-4ffd-4f39-b63d-063eb44e3178 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.289157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.290184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.290184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.290903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.291152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:00:13.291723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.293115 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.307649 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1213/2452] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:00:13.311771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.321989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940cdbe-3d86-44f1-ab28-7620875f2a57 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.326704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.327365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.327648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.328124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.328811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.330773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.359368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1240/2453] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:13.363505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.375051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7376-3518-4056-8307-cbea2b173d0f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.430889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:13.443675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.444653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.445119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.445544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.446418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.450025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.477657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1214/2454] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:13.481966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.494138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b434ce-a2a4-457d-b35a-9e76895ff734 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.499417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.500126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.500634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.500919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.501711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.503310 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.519685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1241/2455] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:13.525250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.538130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836c55-73a0-4c6d-9b2a-be45ba465856 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.543431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f49bf-43db-4a50-a2d0-7561889d6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.544250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f49bf-43db-4a50-a2d0-7561889d6351 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.544606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f49bf-43db-4a50-a2d0-7561889d6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.545123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f49bf-43db-4a50-a2d0-7561889d6351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.545924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f49bf-43db-4a50-a2d0-7561889d6351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.547703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f49bf-43db-4a50-a2d0-7561889d6351 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.558593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1215/2456] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:00:13.562449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.574992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905186b2-0564-43a9-8671-20ba0cb98ddf admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.580466 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.581544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.581910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.582249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] PATH_INFO: `/v3/projects/fa063e62a1e648d49c6c81ba6dad8f79/users/23c44eff32384239bcdacf50ce34fcca/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.600052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa063e62a1e648d49c6c81ba6dad8f79, user_id=23c44eff32384239bcdacf50ce34fcca, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.603028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.618166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1242/2457] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:13 2022] PUT /identity/v3/projects/fa063e62a1e648d49c6c81ba6dad8f79/users/23c44eff32384239bcdacf50ce34fcca/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:13.628821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.629665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.629969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.659381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] MFA Rules not processed for user `23c44eff32384239bcdacf50ce34fcca`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:13.660597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:13.727896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1216/2458] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:13.732686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.812349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dd49-0661-444e-a0a0-5c10430ed02f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.817047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.817707 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.818059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.818851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.819697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.821741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.835559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:13.848757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1243/2459] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:13.852791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.863430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d99d9-141d-4f8c-b1b6-a16cc1e135b8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.920368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.921221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.921625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.921857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.922542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.924487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.954423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1217/2460] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:13 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:13.955586 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:13.966732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a0c23-70e0-4fd4-8719-88561040681d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:13.972919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758f402-113a-4a80-881c-464abf93a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:13.973628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f402-113a-4a80-881c-464abf93a4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:13.973923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f402-113a-4a80-881c-464abf93a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:13.974266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f402-113a-4a80-881c-464abf93a4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:13.974960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758f402-113a-4a80-881c-464abf93a4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:13.976590 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758f402-113a-4a80-881c-464abf93a4c3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:13.988417 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1244/2461] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:00:13.993474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.007429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9fe9d-a075-41c6-bcfb-8a0ae8aec7b0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:14.012313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:14.013465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.013465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.013641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] PATH_INFO: `/v3/projects/becfb24fa3b045479b09e5cd8fcad1ff/users/80469438450048b3b6b1d60ef77317a5/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.025050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33270-964f-476d-980e-e5e370598695 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.025338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33270-964f-476d-980e-e5e370598695 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.025617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33270-964f-476d-980e-e5e370598695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.035319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=becfb24fa3b045479b09e5cd8fcad1ff, user_id=80469438450048b3b6b1d60ef77317a5, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:14.040101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:14.044434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fbb33270-964f-476d-980e-e5e370598695 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:14.045673 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fbb33270-964f-476d-980e-e5e370598695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:14.058031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1218/2462] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:13 2022] PUT /identity/v3/projects/becfb24fa3b045479b09e5cd8fcad1ff/users/80469438450048b3b6b1d60ef77317a5/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:14.061865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.098911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:14.108672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1245/2463] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:14.121537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33270-964f-476d-980e-e5e370598695 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.122965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fbb33270-964f-476d-980e-e5e370598695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:14.155847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a495-de8c-4754-b612-7697cf1f18ef admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:14.162565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:14.163250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.163534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.163857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.164916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:14.167027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:14.178381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1219/2464] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:14.182265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.191880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80914-073f-4f56-91f3-e5b233ef23b6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:14.196542 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec3342-48bc-4bc2-985e-d033fb727664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:14.197433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec3342-48bc-4bc2-985e-d033fb727664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.197719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec3342-48bc-4bc2-985e-d033fb727664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.197995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec3342-48bc-4bc2-985e-d033fb727664 admin admin] PATH_INFO: `/v3/projects/becfb24fa3b045479b09e5cd8fcad1ff/users/80469438450048b3b6b1d60ef77317a5/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.199953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec3342-48bc-4bc2-985e-d033fb727664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becfb24fa3b045479b09e5cd8fcad1ff, user_id=80469438450048b3b6b1d60ef77317a5, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:14.202644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec3342-48bc-4bc2-985e-d033fb727664 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:14.207641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33270-964f-476d-980e-e5e370598695 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:14.213475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1220/2465] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:14 2022] PUT /identity/v3/projects/becfb24fa3b045479b09e5cd8fcad1ff/users/80469438450048b3b6b1d60ef77317a5/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:00:14.225208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.225208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.225887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.252683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] MFA Rules not processed for user `80469438450048b3b6b1d60ef77317a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:14.253880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:14.270509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:14.271303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.271566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.271840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.302285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:14.327898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1221/2466] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:14.334814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:14.335754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:14.339317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.341190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:14.344870 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1246/2467] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:00:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:00:14.409298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb68b2-bda4-44b7-91cd-2cd2d0ea3739 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:14.413354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4ce96-f0db-4449-a255-bdc05f7d3720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:14.414044 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4ce96-f0db-4449-a255-bdc05f7d3720 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.414327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4ce96-f0db-4449-a255-bdc05f7d3720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.414603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4ce96-f0db-4449-a255-bdc05f7d3720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.426788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4ce96-f0db-4449-a255-bdc05f7d3720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:14.429594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4ce96-f0db-4449-a255-bdc05f7d3720 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:14.444810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1222/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:00:14.495754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.617504 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c69e-57ec-4fad-9ab0-fc2b1d7e68fd service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:14.624022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:14.625364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.625806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.626301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] PATH_INFO: `/v3/users/23c44eff32384239bcdacf50ce34fcca` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.627885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c44eff32384239bcdacf50ce34fcca)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:14.630150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:14.701716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c44eff32384239bcdacf50ce34fcca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:14.726039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c44eff32384239bcdacf50ce34fcca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:14.753423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c44eff32384239bcdacf50ce34fcca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:14.757072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c44eff32384239bcdacf50ce34fcca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:14.771472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c44eff32384239bcdacf50ce34fcca'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:14.781689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1247/2469] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:14 2022] DELETE /identity/v3/users/23c44eff32384239bcdacf50ce34fcca => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:14.786356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:14.786678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:14.787089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:14.813307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:14.814785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:14.894116 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:14.944524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1223/2470] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:14.951691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:14.953402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:15.026458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2362348-974b-491b-8cff-3423c19bd17f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:15.030301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:15.030959 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:15.031222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:15.031509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:15.038095 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:15.043303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:15.045645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:15.059887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1248/2471] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:15.508858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:15.511243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:15.537410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67bcfb-8ea8-459a-96f9-40744ea06829 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:15.550501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:15.554013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:15.554312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:15.556817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] PATH_INFO: `/v3/projects/fa063e62a1e648d49c6c81ba6dad8f79` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:15.560553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa063e62a1e648d49c6c81ba6dad8f79)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:15.563244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:15.634736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa063e62a1e648d49c6c81ba6dad8f79', 'request_id': 'req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.641537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa063e62a1e648d49c6c81ba6dad8f79', 'request_id': 'req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.651758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa063e62a1e648d49c6c81ba6dad8f79', 'request_id': 'req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.665133 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] The token cache is being invalidate because project fa063e62a1e648d49c6c81ba6dad8f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:15.665417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.666059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.667588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1224/2472] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:15 2022] DELETE /identity/v3/projects/fa063e62a1e648d49c6c81ba6dad8f79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:15.671537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:15.682327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d518a-bbf2-43cb-a27f-e6557c3c09ab service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:15.752362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:15.753321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:15.753626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:15.754096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] PATH_INFO: `/v3/users/80469438450048b3b6b1d60ef77317a5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:15.755684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80469438450048b3b6b1d60ef77317a5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:15.758051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:15.812239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80469438450048b3b6b1d60ef77317a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.827157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80469438450048b3b6b1d60ef77317a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.834494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80469438450048b3b6b1d60ef77317a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.835271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80469438450048b3b6b1d60ef77317a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.842668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3f9a9e21-c5d6-4e82-aefc-455608432406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80469438450048b3b6b1d60ef77317a5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:15.848922 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1249/2473] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:15 2022] DELETE /identity/v3/users/80469438450048b3b6b1d60ef77317a5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:16.244635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.246126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:16.259441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b648a-aa9f-4ba3-9db2-d4ebe0457e08 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.332119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.333037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.333325 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.334203 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] PATH_INFO: `/v3/projects/becfb24fa3b045479b09e5cd8fcad1ff` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.335669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=becfb24fa3b045479b09e5cd8fcad1ff)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.337696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:16.389215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becfb24fa3b045479b09e5cd8fcad1ff', 'request_id': 'req-317895f3-9768-452e-a53d-efa01c5ca0c0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:16.397060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becfb24fa3b045479b09e5cd8fcad1ff', 'request_id': 'req-317895f3-9768-452e-a53d-efa01c5ca0c0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:16.412920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:16.423209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becfb24fa3b045479b09e5cd8fcad1ff', 'request_id': 'req-317895f3-9768-452e-a53d-efa01c5ca0c0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:16.453300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] The token cache is being invalidate because project becfb24fa3b045479b09e5cd8fcad1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:16.453671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:16.454530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-317895f3-9768-452e-a53d-efa01c5ca0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:16.456904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1225/2474] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:16 2022] DELETE /identity/v3/projects/becfb24fa3b045479b09e5cd8fcad1ff => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:16.462761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.463051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.463335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.483587 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:16.484820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:16.568480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1250/2475] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:16.572642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.573176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.573280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.592872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:16.594208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:16.608944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1226/2476] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:16.610238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.623191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146fbb8-310b-451d-872f-d1d6e581c944 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.628588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.629735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.630231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.631269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.632582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:00:16.633167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.635552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:16.650356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:16.655990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1251/2477] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:00:16.659661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.672382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d48f0-dbc7-4a2c-b579-d6af369babf2 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.678377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.679186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.679579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.679961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.680774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.682926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:16.714065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1227/2478] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:16 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:00:16.718421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.730409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce896e0-ea8e-4dce-93fa-fb7c41e08a8a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.821274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.821952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.822243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.822520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.823255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.825271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:16.855685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1252/2479] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:16 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:16.856374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.877209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833c11-dbaf-44e3-b390-421f4fe02cd6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.883220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.884060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.884484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.884752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.885598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.887347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:16.900596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1228/2480] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:16.904414 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.916526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c1b0f-7c01-4feb-8eef-7bf4071f7367 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.922136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538357-0bc8-4d89-a3c9-25499dff61d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.922934 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538357-0bc8-4d89-a3c9-25499dff61d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.923292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538357-0bc8-4d89-a3c9-25499dff61d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.923642 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538357-0bc8-4d89-a3c9-25499dff61d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.924447 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538357-0bc8-4d89-a3c9-25499dff61d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.926209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538357-0bc8-4d89-a3c9-25499dff61d8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:16.946511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1253/2481] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:16.950901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:16.961941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e2f50-3a3f-4690-a1a5-4cf1aa83e84a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:16.966838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:16.967726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:16.968017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:16.968292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] PATH_INFO: `/v3/projects/71336dcf9c4e4bffa91db54ffc61e407/users/e70c96e461584cb4b135737d74446eba/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:16.986818 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71336dcf9c4e4bffa91db54ffc61e407, user_id=e70c96e461584cb4b135737d74446eba, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:16.989615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:17.018313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1229/2482] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:16 2022] PUT /identity/v3/projects/71336dcf9c4e4bffa91db54ffc61e407/users/e70c96e461584cb4b135737d74446eba/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:00:17.019679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:17.020295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:17.020655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:17.056841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] MFA Rules not processed for user `e70c96e461584cb4b135737d74446eba`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:17.058743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:17.074559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:17.076407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:17.186476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1254/2483] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:17.187935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:17.189558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:17.204564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec9ac2-8a98-43b4-9baf-b45555d738c9 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:17.220176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:17.222099 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:17.222490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:17.222778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:17.226319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:17.317628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14b4e-1459-409d-8e26-5f3e3462969a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:17.323761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:17.325354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633e026-4e2c-4847-bb26-81b5f693f148 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:17.329952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:17.330635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:17.330916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:17.331194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:17.349587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1230/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:00:17.378897 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:17.381098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:17.406082 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1255/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:27.337113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:27.389004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:30.932701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:30.933214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:30.933320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:30.951585 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:30.952758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:31.006834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1231/2486] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 5 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:31.018603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:31.020799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:31.090926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d1a4e-9403-4c65-b7ae-9eaa2b1f4929 service glance] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:31.095965 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b27b5-f56c-4ae1-9f3a-89d81f87bd7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:31.096729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b27b5-f56c-4ae1-9f3a-89d81f87bd7e service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:31.097050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b27b5-f56c-4ae1-9f3a-89d81f87bd7e service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:31.097339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b27b5-f56c-4ae1-9f3a-89d81f87bd7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:31.107694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b27b5-f56c-4ae1-9f3a-89d81f87bd7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:31.109346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b27b5-f56c-4ae1-9f3a-89d81f87bd7e service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:31.117932 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1256/2487] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:00:35.265084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:35.334682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52aca3a-155b-4102-926a-8aec9e4a24dd None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:35.339783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:35.340786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:35.341181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:35.341534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] PATH_INFO: `/v3/users/e70c96e461584cb4b135737d74446eba` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:35.342998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70c96e461584cb4b135737d74446eba)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:35.345176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:35.416405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70c96e461584cb4b135737d74446eba'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:35.430973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70c96e461584cb4b135737d74446eba'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:35.439118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70c96e461584cb4b135737d74446eba'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:35.440250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70c96e461584cb4b135737d74446eba'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:35.450161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70c96e461584cb4b135737d74446eba'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:35.458905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1232/2488] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:35 2022] DELETE /identity/v3/users/e70c96e461584cb4b135737d74446eba => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:00:35.463796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:35.464813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:35.465340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:35.486899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:35.488208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:35.579442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1257/2489] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:35.589512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:35.591957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:35.624338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:35.659705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35619e8-22b9-47a8-9b87-1920a67a9960 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:35.663878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c2543-e08a-4437-8b6e-0be369433dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:35.664636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2543-e08a-4437-8b6e-0be369433dff service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:35.665020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2543-e08a-4437-8b6e-0be369433dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:35.665367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2543-e08a-4437-8b6e-0be369433dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:35.675135 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c2543-e08a-4437-8b6e-0be369433dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:35.677812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c2543-e08a-4437-8b6e-0be369433dff service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:35.689303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1233/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:36.158062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.159750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:36.173398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7b33c-fc0f-4b65-88d0-6a501489a349 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.184660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.185779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.185970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.186391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] PATH_INFO: `/v3/projects/71336dcf9c4e4bffa91db54ffc61e407` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.187790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71336dcf9c4e4bffa91db54ffc61e407)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.189960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.240075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71336dcf9c4e4bffa91db54ffc61e407', 'request_id': 'req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:36.245706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71336dcf9c4e4bffa91db54ffc61e407', 'request_id': 'req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:36.251940 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71336dcf9c4e4bffa91db54ffc61e407', 'request_id': 'req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:36.265879 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] The token cache is being invalidate because project 71336dcf9c4e4bffa91db54ffc61e407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:36.266090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:36.266712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f0bc0c5d-724b-44ee-a8c1-c3515bd5a51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:36.268352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1258/2491] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:36 2022] DELETE /identity/v3/projects/71336dcf9c4e4bffa91db54ffc61e407 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:36.274704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.275221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.275324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.293703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:36.294916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:36.356724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1234/2492] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:36.365976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.366264 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.366542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.385398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:36.386608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:36.395407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1259/2493] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:36.399843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.409758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a1335-6003-44a7-918d-f70a42910bbf None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.415106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.415758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.416042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.416316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.417066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:00:36.417372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.418962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.431316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1235/2494] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:00:36.435679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.447842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0d0e6-8bb7-4e8e-96c0-795c12876bb5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.452532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.453238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.453522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.453797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.454494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.456396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.461154 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:36.488530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1260/2495] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:36 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:36.492703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.502834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee080d-6e1b-4362-b605-a2641981d565 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.568306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.569213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.569769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.570544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.572153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.574468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.604993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1236/2496] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:36 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:36.609076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.620597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1ff1c-c6b7-4d1f-a8ff-4b9ca589faf7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.625308 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.625979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.626263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.626603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.627258 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.628883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.642649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1261/2497] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:00:36.645091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.655412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81faf-4b82-42a2-8a6c-4d6b7d46e9fc admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.660042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da0b25-b01f-4659-a4d3-a23d48cd4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.661319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0b25-b01f-4659-a4d3-a23d48cd4dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.661843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0b25-b01f-4659-a4d3-a23d48cd4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.662132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da0b25-b01f-4659-a4d3-a23d48cd4dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.662856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0b25-b01f-4659-a4d3-a23d48cd4dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.664461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da0b25-b01f-4659-a4d3-a23d48cd4dfd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.674860 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1237/2498] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:36.679695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.690195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcd904-c42c-41b5-9886-eac25945b090 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.694936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.695820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.696113 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.696388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] PATH_INFO: `/v3/projects/3bb50064f240430c983bc02970f13e03/users/b7657c8b3e9240f49600ef37b6225bb3/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.711748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb50064f240430c983bc02970f13e03, user_id=b7657c8b3e9240f49600ef37b6225bb3, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.714538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.729190 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1262/2499] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:36 2022] PUT /identity/v3/projects/3bb50064f240430c983bc02970f13e03/users/b7657c8b3e9240f49600ef37b6225bb3/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:36.739955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.740313 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.740601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.773667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] MFA Rules not processed for user `b7657c8b3e9240f49600ef37b6225bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:36.774909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:36.798961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:36.845300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1238/2500] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:36.857107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:36.859158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:36.924267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39431145-7e39-4b79-a28d-a00c1df66a4b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:36.929565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c057bc-1160-4ffb-bf29-848ba4ab6fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:36.932491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c057bc-1160-4ffb-bf29-848ba4ab6fab service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:36.932795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c057bc-1160-4ffb-bf29-848ba4ab6fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:36.933318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c057bc-1160-4ffb-bf29-848ba4ab6fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:36.944215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c057bc-1160-4ffb-bf29-848ba4ab6fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:36.945693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c057bc-1160-4ffb-bf29-848ba4ab6fab service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:36.955225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1263/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:46.842132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=17 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:46.880618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:46.944855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cfec4-0122-40c5-8233-a6653450ed74 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:46.949881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:46.950782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:46.950919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:46.951477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:46.951477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] PATH_INFO: `/v3/users/b7657c8b3e9240f49600ef37b6225bb3` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:46.952608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7657c8b3e9240f49600ef37b6225bb3)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:46.954742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:47.005035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7657c8b3e9240f49600ef37b6225bb3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.017383 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7657c8b3e9240f49600ef37b6225bb3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.024565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7657c8b3e9240f49600ef37b6225bb3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.025302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7657c8b3e9240f49600ef37b6225bb3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.033406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7657c8b3e9240f49600ef37b6225bb3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.039917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1239/2502] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:46 2022] DELETE /identity/v3/users/b7657c8b3e9240f49600ef37b6225bb3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:47.044737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.045083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.045365 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.064317 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:47.065555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:47.127627 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1264/2503] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:00:47.137903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:47.139326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:47.212062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba35bac-fbd2-49d1-94a7-49f60daee2c6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:47.216128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa5f7-f650-433b-831d-64f933332049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:47.217051 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa5f7-f650-433b-831d-64f933332049 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.217341 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa5f7-f650-433b-831d-64f933332049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.217616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa5f7-f650-433b-831d-64f933332049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.227581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fa5f7-f650-433b-831d-64f933332049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:47.229037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fa5f7-f650-433b-831d-64f933332049 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:47.238804 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1240/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:47.589386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:47.590813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:47.608923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87440a-8da2-4ede-b102-6be2b76892b1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:47.617556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:47.618489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.618710 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.618995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] PATH_INFO: `/v3/projects/3bb50064f240430c983bc02970f13e03` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.620172 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb50064f240430c983bc02970f13e03)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:47.622140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:47.670305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb50064f240430c983bc02970f13e03', 'request_id': 'req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.676748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb50064f240430c983bc02970f13e03', 'request_id': 'req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.682998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb50064f240430c983bc02970f13e03', 'request_id': 'req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.697774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] The token cache is being invalidate because project 3bb50064f240430c983bc02970f13e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:00:47.698070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.698691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-28c8b0d2-84a5-4a35-ba2a-0032c00ebb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:47.700254 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1265/2505] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:00:47 2022] DELETE /identity/v3/projects/3bb50064f240430c983bc02970f13e03 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:47.705208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.705500 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.705780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.723593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:47.724801 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:47.741835 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:47.788075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1241/2506] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:47.796752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.797102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.797410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.815815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:47.817623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:47.825756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1266/2507] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:47.829847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:47.839615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6485-09da-4ecd-ac4d-45e78b8d86c9 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:47.844067 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:47.844709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.845022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.845294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.846009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:00:47.846312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:47.848495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:47.859832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1242/2508] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:00:47.864644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:47.873744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956a581-a4bc-4064-8ab7-fc30e0290b05 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:47.878531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:47.879437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.879722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.879997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.880681 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:47.882639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:47.917865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1267/2509] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:00:47 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:00:47.921857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:47.932685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6908-9dd6-42d6-a93d-c9246c105ee1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:47.988612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:47.989562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:47.989848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:47.990119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:47.990809 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:47.992735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:48.015881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1243/2510] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:00:47 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:00:48.021323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:48.031737 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346a4b0-308e-4e7b-9337-49217e75162a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:48.036902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:48.037581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:48.037864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:48.038141 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:48.038861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:48.040459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:48.050333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1268/2511] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:00:48.055038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:48.064920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4ccc-424b-4884-9af7-92d3771a5497 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:48.069524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab3683-db04-4020-8965-c7d94cbe6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:48.070169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab3683-db04-4020-8965-c7d94cbe6a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:48.070453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab3683-db04-4020-8965-c7d94cbe6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:48.070725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab3683-db04-4020-8965-c7d94cbe6a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:48.071435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab3683-db04-4020-8965-c7d94cbe6a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:48.073072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab3683-db04-4020-8965-c7d94cbe6a2e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:48.082855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1244/2512] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:00:48.086839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:48.096728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6341a-19a0-44e5-8037-35b8c9369331 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:48.101836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:48.102702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:48.102988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:48.103263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] PATH_INFO: `/v3/projects/983b3f0a085c45508d9a90a1b636a142/users/8b26cb0743ba46809d9a9f414ae7555c/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:48.118177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983b3f0a085c45508d9a90a1b636a142, user_id=8b26cb0743ba46809d9a9f414ae7555c, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:48.120865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:48.134362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1269/2513] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:00:48 2022] PUT /identity/v3/projects/983b3f0a085c45508d9a90a1b636a142/users/8b26cb0743ba46809d9a9f414ae7555c/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:00:48.200312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249564f7-312c-4ed3-8894-6de7be69d7b2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:48.200603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249564f7-312c-4ed3-8894-6de7be69d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:48.200882 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249564f7-312c-4ed3-8894-6de7be69d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:48.228173 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-249564f7-312c-4ed3-8894-6de7be69d7b2 None None] MFA Rules not processed for user `8b26cb0743ba46809d9a9f414ae7555c`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:48.229403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-249564f7-312c-4ed3-8894-6de7be69d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:48.293656 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1245/2514] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:48.304369 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:48.306075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:48.319560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:48.363888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52c2b7-9c4f-40c2-b915-5812ad8d3181 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:48.367458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:48.368091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:48.368372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:48.368647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:48.376803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:48.378257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:48.386910 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1270/2515] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:49.734503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:49.735093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:49.735224 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:49.771410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] MFA Rules not processed for user `8b26cb0743ba46809d9a9f414ae7555c`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:00:49.772914 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:49.787572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1246/2516] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:00:50.471985 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:50.473847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:50.593513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a2b9e-67d2-4722-b3da-ee37c544799f service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:50.601521 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:50.603664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:50.604361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:50.604983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:50.607100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:50.622478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:50.624633 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:50.638385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1271/2517] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:56.188961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:56.190422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:56.204431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:56.258436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f71b56-6935-41ad-8549-9c6878f64ba4 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:56.262018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:56.262666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:56.262946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:56.263218 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:56.265321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:56.344204 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:56.345863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:56.357885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1247/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:59.840359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:59.841956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:59.860187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ba41-f67b-40e6-9d80-a41997c542bb service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:59.864912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:59.865829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:59.866114 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:59.866399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] PATH_INFO: `/v3/users/5eac41ce3f04450b840cff305ec1a5ac` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:59.867647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eac41ce3f04450b840cff305ec1a5ac)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:59.869674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:59.940035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eac41ce3f04450b840cff305ec1a5ac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:59.954208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eac41ce3f04450b840cff305ec1a5ac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:59.965508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eac41ce3f04450b840cff305ec1a5ac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:59.966311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eac41ce3f04450b840cff305ec1a5ac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:59.982839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f13c87ef-3419-4abf-ae24-998e4a850400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eac41ce3f04450b840cff305ec1a5ac'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:00:59.990675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1272/2519] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:00:59 2022] DELETE /identity/v3/users/5eac41ce3f04450b840cff305ec1a5ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:00.181598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.192944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef450749-15d6-4366-a7b6-f94cfbca0933 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.251192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.252042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.252318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.252588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] PATH_INFO: `/v3/projects/c47e1ad014d542f98f6b24c8a504d166` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.253871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47e1ad014d542f98f6b24c8a504d166)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.255775 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.300636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47e1ad014d542f98f6b24c8a504d166', 'request_id': 'req-d49c282a-2d67-47e2-b0de-5eb769316653'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:00.308162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47e1ad014d542f98f6b24c8a504d166', 'request_id': 'req-d49c282a-2d67-47e2-b0de-5eb769316653'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:00.311715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:00.316723 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47e1ad014d542f98f6b24c8a504d166', 'request_id': 'req-d49c282a-2d67-47e2-b0de-5eb769316653'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:00.329060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] The token cache is being invalidate because project c47e1ad014d542f98f6b24c8a504d166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:00.329349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:00.329966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-d49c282a-2d67-47e2-b0de-5eb769316653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:00.332107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1248/2520] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:00 2022] DELETE /identity/v3/projects/c47e1ad014d542f98f6b24c8a504d166 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:00.337085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.337409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.337689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.356805 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:00.358030 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:00.363399 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:00.417734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1273/2521] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:00.426206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.426503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.426757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.444575 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:00.445783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:00.453486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1249/2522] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:00.458789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.468411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3f115-be85-43a7-8062-0d5ba0f60171 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.473644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.474297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.474578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.474853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.475571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:00.475876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.477501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.489852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1274/2523] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:00.493921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.503523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864607e6-43e3-4d2b-8438-36069295e8b8 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.508319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.508982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.509265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.509537 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.510212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.512095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.538025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1250/2524] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:00.542065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.552490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c780-180e-4418-89d4-eb3b4b87c4b9 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.609629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.610679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.611146 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.611502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.612198 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.614835 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.638773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1275/2525] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:00.639923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.650621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28d8da-55d2-491f-9f03-67982b8fedfc admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.655943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.656855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.657227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.657713 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.658593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.661266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.673451 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1251/2526] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:00.677678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.688423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb896c8a-d70b-4693-90a9-6a422a5f2a46 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.693453 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495e0e1-b720-448d-b56a-8c45af07d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.694120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495e0e1-b720-448d-b56a-8c45af07d6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.694425 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495e0e1-b720-448d-b56a-8c45af07d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.694682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495e0e1-b720-448d-b56a-8c45af07d6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.695406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495e0e1-b720-448d-b56a-8c45af07d6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.697041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495e0e1-b720-448d-b56a-8c45af07d6ed admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.708032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1276/2527] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:00.712050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.722716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc137d64-f3fa-4f37-8ac2-0439f85c1746 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.727310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.728183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.728468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.728742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] PATH_INFO: `/v3/projects/0aa640ad6c7747ccb38d0d4886f04409/users/cbf3f05625ac4d11ab3a7d0aa138ac58/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.743322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa640ad6c7747ccb38d0d4886f04409, user_id=cbf3f05625ac4d11ab3a7d0aa138ac58, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.746023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.763998 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1252/2528] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:00 2022] PUT /identity/v3/projects/0aa640ad6c7747ccb38d0d4886f04409/users/cbf3f05625ac4d11ab3a7d0aa138ac58/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:00.775089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.775383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.775660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.802294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] MFA Rules not processed for user `cbf3f05625ac4d11ab3a7d0aa138ac58`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:00.803501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:00.870578 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1277/2529] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:00.874936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.939186 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648f9b-3f33-49d8-806f-f95ea764e5ff admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.944799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:00.945493 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:00.946002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:00.946286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:00.946969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:00.948865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:00.977473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1253/2530] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:00.978603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:00.989809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c75068-d028-4a18-af7e-25e262aa27e9 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:00.993302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:01.046836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.047499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.047778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.048051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.048735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.051570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.073056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1278/2531] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:00 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:01:01.077059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.087295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b5dfa-7c7b-410e-9125-1a9dcc6ce5be admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.091895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.092545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.092830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.093154 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.093895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.095502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.106228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1254/2532] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:01.110284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.120718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665bef-d03b-4554-bb99-8198746f9a5e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.125403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.126278 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.126563 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.126841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] PATH_INFO: `/v3/projects/de270f977d004ab19bc46cb3af2f2140/users/1e9f42cf16cb4672a6149979e88bff6b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.142066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de270f977d004ab19bc46cb3af2f2140, user_id=1e9f42cf16cb4672a6149979e88bff6b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.145367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.158210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1279/2533] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:01 2022] PUT /identity/v3/projects/de270f977d004ab19bc46cb3af2f2140/users/1e9f42cf16cb4672a6149979e88bff6b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:01.162392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.172276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c88a6-f75b-4557-8bd2-0dbf58fc4840 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.227275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56493d-25c5-4b9c-92a3-23dca8aa15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.227939 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56493d-25c5-4b9c-92a3-23dca8aa15a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.228124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56493d-25c5-4b9c-92a3-23dca8aa15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.228397 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56493d-25c5-4b9c-92a3-23dca8aa15a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.229142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56493d-25c5-4b9c-92a3-23dca8aa15a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.230748 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56493d-25c5-4b9c-92a3-23dca8aa15a0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.232840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:01.242484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1255/2534] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:01.246460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.257334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504eb8a-06ec-47c4-8a3b-53016e61e862 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.261921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.262800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.263077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.263349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] PATH_INFO: `/v3/projects/de270f977d004ab19bc46cb3af2f2140/users/1e9f42cf16cb4672a6149979e88bff6b/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.265341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de270f977d004ab19bc46cb3af2f2140, user_id=1e9f42cf16cb4672a6149979e88bff6b, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.267973 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.278470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1280/2535] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:01 2022] PUT /identity/v3/projects/de270f977d004ab19bc46cb3af2f2140/users/1e9f42cf16cb4672a6149979e88bff6b/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:01.288736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.289087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.289372 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.316791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] MFA Rules not processed for user `1e9f42cf16cb4672a6149979e88bff6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:01.318036 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:01.385330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1256/2536] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:01.396579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.398384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:01.455128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115bd47-ade5-42c9-94ac-32277e0b5cb1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.459210 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dc345-b1a4-4b35-8b33-347bed947128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.459851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc345-b1a4-4b35-8b33-347bed947128 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.460139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc345-b1a4-4b35-8b33-347bed947128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.460413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dc345-b1a4-4b35-8b33-347bed947128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.469334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dc345-b1a4-4b35-8b33-347bed947128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.470771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dc345-b1a4-4b35-8b33-347bed947128 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.481195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1281/2537] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:01.625343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.689356 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13bec3-f62a-4346-8f04-2cc0c852fe8c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.694105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.695001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.695285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.695559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] PATH_INFO: `/v3/users/cbf3f05625ac4d11ab3a7d0aa138ac58` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.696729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf3f05625ac4d11ab3a7d0aa138ac58)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.698706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.745694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf3f05625ac4d11ab3a7d0aa138ac58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:01.757364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf3f05625ac4d11ab3a7d0aa138ac58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:01.764096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf3f05625ac4d11ab3a7d0aa138ac58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:01.764901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf3f05625ac4d11ab3a7d0aa138ac58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:01.778362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf3f05625ac4d11ab3a7d0aa138ac58'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:01.785665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1257/2538] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:01 2022] DELETE /identity/v3/users/cbf3f05625ac4d11ab3a7d0aa138ac58 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:01.790712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.790999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.791343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.808895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:01.810125 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:01.870088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1282/2539] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:01.880053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:01.881604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:01.887041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:01.941937 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd0676-5e0a-4903-8b16-d5b692169eed admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:01.945594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:01.946247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:01.946532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:01.946810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:01.955683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:01.958002 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:01.967945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1258/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:02.326952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:02.329117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:02.338250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:02.345612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d68cec-6096-4ee3-8efa-c9316f767b65 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:02.355296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:02.356259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:02.356610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:02.356979 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] PATH_INFO: `/v3/projects/0aa640ad6c7747ccb38d0d4886f04409` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:02.358326 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa640ad6c7747ccb38d0d4886f04409)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:02.360443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:02.413285 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa640ad6c7747ccb38d0d4886f04409', 'request_id': 'req-71b9162d-af09-4163-bf59-b8ff6419c6c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.418902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa640ad6c7747ccb38d0d4886f04409', 'request_id': 'req-71b9162d-af09-4163-bf59-b8ff6419c6c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.425518 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa640ad6c7747ccb38d0d4886f04409', 'request_id': 'req-71b9162d-af09-4163-bf59-b8ff6419c6c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.438550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] The token cache is being invalidate because project 0aa640ad6c7747ccb38d0d4886f04409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:02.438926 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.439667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.442120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1283/2541] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:02 2022] DELETE /identity/v3/projects/0aa640ad6c7747ccb38d0d4886f04409 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:02.446048 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:02.455650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38932e-40de-417f-9d8d-d8f3aee92d1d service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:02.514862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:02.515740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:02.516020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:02.516294 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] PATH_INFO: `/v3/users/1e9f42cf16cb4672a6149979e88bff6b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:02.517503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9f42cf16cb4672a6149979e88bff6b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:02.520548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:02.567492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9f42cf16cb4672a6149979e88bff6b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.579517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9f42cf16cb4672a6149979e88bff6b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.586331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9f42cf16cb4672a6149979e88bff6b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.586999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9f42cf16cb4672a6149979e88bff6b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.594233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b9a84873-079d-45c6-8f3e-361a01b05ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9f42cf16cb4672a6149979e88bff6b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:02.600427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1259/2542] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:02 2022] DELETE /identity/v3/users/1e9f42cf16cb4672a6149979e88bff6b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:02.865424 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:02.866904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:02.884012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9162d-af09-4163-bf59-b8ff6419c6c6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:02.945086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:02.945992 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:02.946275 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:02.946549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] PATH_INFO: `/v3/projects/de270f977d004ab19bc46cb3af2f2140` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:02.947739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de270f977d004ab19bc46cb3af2f2140)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:02.949715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:02.995295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de270f977d004ab19bc46cb3af2f2140', 'request_id': 'req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:03.000708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de270f977d004ab19bc46cb3af2f2140', 'request_id': 'req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:03.007206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de270f977d004ab19bc46cb3af2f2140', 'request_id': 'req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:03.020155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] The token cache is being invalidate because project de270f977d004ab19bc46cb3af2f2140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:03.020455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:03.021112 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-bced823c-cd78-42bd-8b9b-77ea8cb1f18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:03.022702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1284/2543] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:02 2022] DELETE /identity/v3/projects/de270f977d004ab19bc46cb3af2f2140 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:03.027694 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.027985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.028268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.046561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:03.047799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:03.066160 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:03.107434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1260/2544] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:03.115351 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.115683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.115967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.134555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:03.135750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:03.144431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1285/2545] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:03.148737 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.158247 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd8b6e-1fb8-42ce-92a0-ea5c01951ffe None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.162857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.163509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.163792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.164069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.164788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:03.165118 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.166715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.179627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1261/2546] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:01:03.184007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.193443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533953-5c28-4843-9dcd-d753ebfb5bcd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.198153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.198802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.199087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.199367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.200051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.202017 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.206554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:03.230899 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1286/2547] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:03 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:03.234875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.244683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe312-01cb-448f-8d3c-0f6b898a7704 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.301327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.301996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.302283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.302562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.303258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.305207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.323993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1262/2548] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:03 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:03.328072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.338223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425d4c-5d88-40b7-8305-bac6b1cf1212 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.342783 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.343434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.343712 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.343986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.344703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.346330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.356064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1287/2549] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:03.359789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.370242 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16bfc-e4b2-4a67-9db2-c994bccf2817 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.374776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e265e-14c3-47ad-808f-e7546b2e56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.375420 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e265e-14c3-47ad-808f-e7546b2e56b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.375703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e265e-14c3-47ad-808f-e7546b2e56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.375979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e265e-14c3-47ad-808f-e7546b2e56b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.376692 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e265e-14c3-47ad-808f-e7546b2e56b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.379389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e265e-14c3-47ad-808f-e7546b2e56b5 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.394298 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1263/2550] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:03.398623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.408603 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664501bc-3d2a-499d-9502-5c1c80112bbb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.413462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.414332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.414610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.414885 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] PATH_INFO: `/v3/projects/bed4c6908fc44fe091bb60aea83b3ac6/users/af3ac9c4c52d4331b2274961def811f3/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.429649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed4c6908fc44fe091bb60aea83b3ac6, user_id=af3ac9c4c52d4331b2274961def811f3, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.432749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.446078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1288/2551] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:03 2022] PUT /identity/v3/projects/bed4c6908fc44fe091bb60aea83b3ac6/users/af3ac9c4c52d4331b2274961def811f3/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:03.451054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026786-83f3-4768-8c38-22d1240af3ee None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.451519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026786-83f3-4768-8c38-22d1240af3ee None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.451618 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026786-83f3-4768-8c38-22d1240af3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.469023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-e5026786-83f3-4768-8c38-22d1240af3ee None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:03.470222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e5026786-83f3-4768-8c38-22d1240af3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:03.530873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1264/2552] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:03.540726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:03.542434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:03.604454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b94e2e-00c1-49b3-be2e-81a9af34baaf admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:03.608164 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:03.608810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:03.609119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:03.609395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:03.619383 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:03.621454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:03.631302 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1289/2553] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:04.270249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.270543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.270816 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.302979 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] MFA Rules not processed for user `af3ac9c4c52d4331b2274961def811f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:04.304302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:04.325657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:04.392783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1265/2554] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:04.397984 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:04.408212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ad7a-d5d1-4576-9433-68c6ea7767c0 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:04.413674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:04.414339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.414625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.414902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.415660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:04.420610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:04.462925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1290/2555] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:04 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:04.466830 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:04.485210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440a81-7681-4166-86fa-5d8b9c7167fc None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:04.586132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:04.586904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.587367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.587704 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.588461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:04.590574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:04.617249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1266/2556] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:04 2022] POST /identity/v3/users => generated 309 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:04.620982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:04.631669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5274b-c77a-4e92-8a69-adf77f0234ea admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:04.636581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:04.637280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.637558 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.637854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.638575 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:04.640179 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:04.651680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1291/2557] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:04.655988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:04.667019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395f268-01a1-4707-b97f-e224fa99cb44 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:04.671628 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:04.672505 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.672789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.673093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] PATH_INFO: `/v3/projects/0bc4a1a2be704a838ceb9cd63192339b/users/c9d6f0c2f9284ff18f5cc18233d631e3/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.689839 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc4a1a2be704a838ceb9cd63192339b, user_id=c9d6f0c2f9284ff18f5cc18233d631e3, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:04.692474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:04.706570 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1267/2558] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:04 2022] PUT /identity/v3/projects/0bc4a1a2be704a838ceb9cd63192339b/users/c9d6f0c2f9284ff18f5cc18233d631e3/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:04.711566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:04.725413 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacb54-667a-4cc1-a0a9-099d2960281c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:04.820887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932da001-a1f3-4499-bfa0-16d953be5206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:04.821911 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da001-a1f3-4499-bfa0-16d953be5206 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.822110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da001-a1f3-4499-bfa0-16d953be5206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.822394 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da001-a1f3-4499-bfa0-16d953be5206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.831729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da001-a1f3-4499-bfa0-16d953be5206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:04.833952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da001-a1f3-4499-bfa0-16d953be5206 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:04.844618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1292/2559] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:04.849601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:04.860167 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bd90d-d8e3-4f54-b21e-c9ce652056de admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:04.865552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecf3e0-c038-4f68-a38b-5027fdc74d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:04.866424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecf3e0-c038-4f68-a38b-5027fdc74d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:04.866699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecf3e0-c038-4f68-a38b-5027fdc74d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:04.866966 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecf3e0-c038-4f68-a38b-5027fdc74d47 admin admin] PATH_INFO: `/v3/projects/0bc4a1a2be704a838ceb9cd63192339b/users/c9d6f0c2f9284ff18f5cc18233d631e3/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:04.868876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecf3e0-c038-4f68-a38b-5027fdc74d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc4a1a2be704a838ceb9cd63192339b, user_id=c9d6f0c2f9284ff18f5cc18233d631e3, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:04.871499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecf3e0-c038-4f68-a38b-5027fdc74d47 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:04.882478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1268/2560] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:04 2022] PUT /identity/v3/projects/0bc4a1a2be704a838ceb9cd63192339b/users/c9d6f0c2f9284ff18f5cc18233d631e3/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:05.476592 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:05.477091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:05.477199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:05.504594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] MFA Rules not processed for user `c9d6f0c2f9284ff18f5cc18233d631e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:05.505839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:05.510849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:05.581236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1293/2561] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:05.969484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb0116-7572-410c-9741-802966faa67c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:05.969964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb0116-7572-410c-9741-802966faa67c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:05.970064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb0116-7572-410c-9741-802966faa67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:05.989132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-27fb0116-7572-410c-9741-802966faa67c None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:05.990258 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-27fb0116-7572-410c-9741-802966faa67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:06.054215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1269/2562] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:06.076056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:06.078194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:06.082456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb0116-7572-410c-9741-802966faa67c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:06.084092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-27fb0116-7572-410c-9741-802966faa67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:06.107219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:06.172811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb0116-7572-410c-9741-802966faa67c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:06.177875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70b73-2f18-4ae4-9386-52bcbb123ed4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:06.179355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:06.180117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:06.180371 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:06.180795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:06.183583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:06.184233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:06.184513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:06.184788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:06.186631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:06.191825 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:06.193843 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:06.200489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:06.202118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c34ac-9e46-4738-816b-26aeb34a0449 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:06.204312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1270/2563] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:01:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:01:06.213849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1294/2564] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:06.703486 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:06.758443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:06.758936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:06.759222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:06.773255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d0ae-d4eb-4314-a1b1-3204592cd887 service swift] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:06.778011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:06.778895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:06.779178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:06.779684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] PATH_INFO: `/v3/users/af3ac9c4c52d4331b2274961def811f3` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:06.780895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3ac9c4c52d4331b2274961def811f3)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:06.782743 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:06.782964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:06.784079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:06.792138 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1295/2565] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 5 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:06.804192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:06.818053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab44de-6e0e-47c7-9cd2-5ef32707508d None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:06.823559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e014a94-fb6d-4536-a8bb-2f0138ac9b6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:06.824225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014a94-fb6d-4536-a8bb-2f0138ac9b6c service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:06.824509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014a94-fb6d-4536-a8bb-2f0138ac9b6c service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:06.824789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e014a94-fb6d-4536-a8bb-2f0138ac9b6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:06.833602 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3ac9c4c52d4331b2274961def811f3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:06.834001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e014a94-fb6d-4536-a8bb-2f0138ac9b6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:06.835612 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e014a94-fb6d-4536-a8bb-2f0138ac9b6c service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:06.843861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1296/2566] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:01:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:01:06.846871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3ac9c4c52d4331b2274961def811f3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:06.854510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3ac9c4c52d4331b2274961def811f3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:06.855342 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3ac9c4c52d4331b2274961def811f3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:06.863590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3ac9c4c52d4331b2274961def811f3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:06.870334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1271/2567] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:06 2022] DELETE /identity/v3/users/af3ac9c4c52d4331b2274961def811f3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:07.047074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.047364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.047644 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.059385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.060997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.068330 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:07.069795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.110761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:07.137914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1297/2568] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:07.150349 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5afdce-540b-4c62-9417-a9b3271e5dfc admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.150800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.152232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.155365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.156231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.156543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.156822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] PATH_INFO: `/v3/projects/bed4c6908fc44fe091bb60aea83b3ac6` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.158053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed4c6908fc44fe091bb60aea83b3ac6)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.161201 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.172175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:07.212158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed4c6908fc44fe091bb60aea83b3ac6', 'request_id': 'req-aab15d10-80d7-41f2-bd78-85013dc74aa0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.217792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed4c6908fc44fe091bb60aea83b3ac6', 'request_id': 'req-aab15d10-80d7-41f2-bd78-85013dc74aa0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.226473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed4c6908fc44fe091bb60aea83b3ac6', 'request_id': 'req-aab15d10-80d7-41f2-bd78-85013dc74aa0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.227650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54556a86-17d8-467f-ba0a-adbcf60c7cfc None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.239017 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] The token cache is being invalidate because project bed4c6908fc44fe091bb60aea83b3ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:07.239343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.240267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.241893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1272/2569] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:07 2022] DELETE /identity/v3/projects/bed4c6908fc44fe091bb60aea83b3ac6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:07.245828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.247197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.288866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.289481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.289763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.290038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.291874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.312507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15d10-80d7-41f2-bd78-85013dc74aa0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.318089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.318967 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.319251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.319529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] PATH_INFO: `/v3/users/c9d6f0c2f9284ff18f5cc18233d631e3` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.320749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d6f0c2f9284ff18f5cc18233d631e3)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.322719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.354882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.356794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.365889 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1298/2570] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:01:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:01:07.372143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d6f0c2f9284ff18f5cc18233d631e3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.381657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:07.387400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d6f0c2f9284ff18f5cc18233d631e3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.396653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d6f0c2f9284ff18f5cc18233d631e3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.397443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d6f0c2f9284ff18f5cc18233d631e3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.405865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ff403523-1164-4c89-903a-156f605be299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d6f0c2f9284ff18f5cc18233d631e3'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.413191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1273/2571] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:07 2022] DELETE /identity/v3/users/c9d6f0c2f9284ff18f5cc18233d631e3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:07.605784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.617933 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e28fd-4aca-4bb8-87df-4cb5c031120e service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.686195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.687065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.687345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.687617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] PATH_INFO: `/v3/projects/0bc4a1a2be704a838ceb9cd63192339b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.688798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc4a1a2be704a838ceb9cd63192339b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.692218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.694857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:07.710126 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.710427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.710709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.728671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:07.729918 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.748955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc4a1a2be704a838ceb9cd63192339b', 'request_id': 'req-c9728e13-b111-4c7a-8887-ed1efee348e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.754974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc4a1a2be704a838ceb9cd63192339b', 'request_id': 'req-c9728e13-b111-4c7a-8887-ed1efee348e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.767470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc4a1a2be704a838ceb9cd63192339b', 'request_id': 'req-c9728e13-b111-4c7a-8887-ed1efee348e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.781459 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] The token cache is being invalidate because project 0bc4a1a2be704a838ceb9cd63192339b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:07.781752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.782408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-c9728e13-b111-4c7a-8887-ed1efee348e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:07.784624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1299/2572] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:07 2022] DELETE /identity/v3/projects/0bc4a1a2be704a838ceb9cd63192339b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:07.789349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a6a8-4886-4f37-a25b-531fec01ea76 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.789628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a6a8-4886-4f37-a25b-531fec01ea76 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.790034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848a6a8-4886-4f37-a25b-531fec01ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.797548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1274/2573] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 5 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:07.807647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3848a6a8-4886-4f37-a25b-531fec01ea76 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:07.808861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3848a6a8-4886-4f37-a25b-531fec01ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.809417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.810932 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.870182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1300/2574] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:07.878246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.878555 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.878837 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.880651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a7a79-8e29-4ce4-bdaa-718be290f3af None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.885805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.886465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.886750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.887028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.896414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.897535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:07.898419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.898730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:07.906724 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1301/2575] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:07.907175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1275/2576] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:01:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:01:07.911364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.921288 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adae4-a48b-4d50-a004-9e8fd3e23fa1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.926849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.927469 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.927678 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.928010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.928641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:07.928978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.930711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.943502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1302/2577] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:01:07.947921 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:07.959517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb02578-a8ee-4be4-8bf8-d53f3f619a3a service swift] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:07.964375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:07.965063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:07.965345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:07.965619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:07.966290 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:07.968175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:07.995509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1276/2578] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:07 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:08.000993 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.015008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6973b-f7ed-4658-bd34-5c46b32848ef admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.083952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.084639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.084923 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.085236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.085929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.087907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.113363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1303/2579] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:07 2022] POST /identity/v3/users => generated 279 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:08.115092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.128137 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e8b74-c79e-4643-9729-3a346be9f20b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.134481 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.135181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.135465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.135863 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.136574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.138213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.149482 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1277/2580] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:08.153463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.160390 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:08.166489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8e53-bfea-496b-989c-c29a1ec63da4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.172878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc93fb-7dc6-4ea3-a30c-39c647e11843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.173652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc93fb-7dc6-4ea3-a30c-39c647e11843 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.173977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc93fb-7dc6-4ea3-a30c-39c647e11843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.175137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc93fb-7dc6-4ea3-a30c-39c647e11843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.176231 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc93fb-7dc6-4ea3-a30c-39c647e11843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.178162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc93fb-7dc6-4ea3-a30c-39c647e11843 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.189038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1304/2581] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:08.194122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.204905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137ff29-1951-443b-8dbd-a0313c0dbbca admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.210175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.211209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.211529 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.211866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] PATH_INFO: `/v3/projects/caf9dae8e8e9436b84ae6a642b9311c8/users/9a3a0d79ebab412a9a0aa30edc47c8c6/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.227468 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf9dae8e8e9436b84ae6a642b9311c8, user_id=9a3a0d79ebab412a9a0aa30edc47c8c6, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.230177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.243941 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1278/2582] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:08 2022] PUT /identity/v3/projects/caf9dae8e8e9436b84ae6a642b9311c8/users/9a3a0d79ebab412a9a0aa30edc47c8c6/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:08.255535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.256050 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.256375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.286529 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] MFA Rules not processed for user `9a3a0d79ebab412a9a0aa30edc47c8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:08.287758 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:08.356956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1305/2583] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:08.362733 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.377593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:08.428358 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932cc15-6780-4c4a-9f0e-e6f61b13dc06 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.433742 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.434405 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.434686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.434954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.435627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.437620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.464667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1279/2584] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:08 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:08.468723 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.480360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbca03-e311-4630-a80c-869c415d25d4 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.540445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.540800 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.541121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.541420 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.542101 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.544042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.563675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1306/2585] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:08 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:08.567772 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.578162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574eb9e-61f0-438a-9f1a-b1727a31c7a9 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.584037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.584711 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.585069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.585352 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.586084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.587696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.602443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1280/2586] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:08.603380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.615237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15fa8a-ef2f-4441-b97f-b272b695ce55 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.619949 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.620839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.621158 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.621440 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] PATH_INFO: `/v3/projects/8c9b532b06964327a0c7764db64edcba/users/52f1feac57f8416dba221f71ce3b674f/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.637493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9b532b06964327a0c7764db64edcba, user_id=52f1feac57f8416dba221f71ce3b674f, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.640209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.654957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1307/2587] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:08 2022] PUT /identity/v3/projects/8c9b532b06964327a0c7764db64edcba/users/52f1feac57f8416dba221f71ce3b674f/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:08.658498 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.669456 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a9c3-7de2-4e87-8588-696eed6223d2 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.736100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c25ca6-3aa6-4e15-8c6e-fde63794db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.736769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c25ca6-3aa6-4e15-8c6e-fde63794db8e admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.737086 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c25ca6-3aa6-4e15-8c6e-fde63794db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.737363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c25ca6-3aa6-4e15-8c6e-fde63794db8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.738084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c25ca6-3aa6-4e15-8c6e-fde63794db8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.739680 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c25ca6-3aa6-4e15-8c6e-fde63794db8e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.750755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1281/2588] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:08.755005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.767202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff168f6-aafb-4eba-bea3-952ddb2b352b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:08.774143 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:08.774687 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.774793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.775324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] PATH_INFO: `/v3/projects/8c9b532b06964327a0c7764db64edcba/users/52f1feac57f8416dba221f71ce3b674f/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.777449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9b532b06964327a0c7764db64edcba, user_id=52f1feac57f8416dba221f71ce3b674f, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:08.780089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:08.796556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1308/2589] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:08 2022] PUT /identity/v3/projects/8c9b532b06964327a0c7764db64edcba/users/52f1feac57f8416dba221f71ce3b674f/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:08.807730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:08.808021 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:08.808297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:08.839940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] MFA Rules not processed for user `52f1feac57f8416dba221f71ce3b674f`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:08.841198 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:08.916401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1282/2590] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:08.929126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:08.931116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:08.969432 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:08.997669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845ea5-2783-44b7-ac9d-7a32ab57811d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:09.002756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:09.003532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:09.003892 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:09.004398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:09.015489 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:09.016920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:09.027187 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1309/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:09.099146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:09.108850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20495757-0039-4bcc-b567-4768e6d55416 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:09.113337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de949bca-7b7e-45d4-a65e-1db4c9e4aff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:09.114015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de949bca-7b7e-45d4-a65e-1db4c9e4aff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:09.114297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de949bca-7b7e-45d4-a65e-1db4c9e4aff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:09.114571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de949bca-7b7e-45d4-a65e-1db4c9e4aff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:09.119782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:09.173107 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de949bca-7b7e-45d4-a65e-1db4c9e4aff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:09.175517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de949bca-7b7e-45d4-a65e-1db4c9e4aff9 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:09.184701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1283/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:10.022801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.024292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:10.089761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483435e-df00-4611-b495-7bbc67810059 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.094341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.095513 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.095804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.096726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] PATH_INFO: `/v3/users/8b26cb0743ba46809d9a9f414ae7555c` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.098215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b26cb0743ba46809d9a9f414ae7555c)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.100200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.146851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b26cb0743ba46809d9a9f414ae7555c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.159753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b26cb0743ba46809d9a9f414ae7555c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.166509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b26cb0743ba46809d9a9f414ae7555c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.167171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b26cb0743ba46809d9a9f414ae7555c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.174799 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b26cb0743ba46809d9a9f414ae7555c'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.180770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1310/2593] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:10 2022] DELETE /identity/v3/users/8b26cb0743ba46809d9a9f414ae7555c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:10.185463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.185971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.186095 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.203975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:10.205230 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:10.263077 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1284/2594] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:10.274007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.275430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:10.334938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdae9-4f60-4d11-a650-0e0a9dde54ad admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.339122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe75dfc-4a60-4e5e-ac22-dfa50b57134c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.339772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe75dfc-4a60-4e5e-ac22-dfa50b57134c service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.340041 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe75dfc-4a60-4e5e-ac22-dfa50b57134c service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.340320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe75dfc-4a60-4e5e-ac22-dfa50b57134c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.350304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe75dfc-4a60-4e5e-ac22-dfa50b57134c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.351735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe75dfc-4a60-4e5e-ac22-dfa50b57134c service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.355744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:10.368915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1311/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:01:10.548953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.550582 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:10.566712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21043d10-9ef8-46f1-9ea7-b353e397e1fc None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.571289 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.572148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.572430 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.572735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] PATH_INFO: `/v3/projects/983b3f0a085c45508d9a90a1b636a142` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.573976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983b3f0a085c45508d9a90a1b636a142)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.575846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.622424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983b3f0a085c45508d9a90a1b636a142', 'request_id': 'req-7d04c79e-da02-4de5-bffd-7e4ce719b263'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.628479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983b3f0a085c45508d9a90a1b636a142', 'request_id': 'req-7d04c79e-da02-4de5-bffd-7e4ce719b263'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.635933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983b3f0a085c45508d9a90a1b636a142', 'request_id': 'req-7d04c79e-da02-4de5-bffd-7e4ce719b263'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.648163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] The token cache is being invalidate because project 983b3f0a085c45508d9a90a1b636a142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:10.648448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.649109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-7d04c79e-da02-4de5-bffd-7e4ce719b263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:10.650631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1285/2596] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:10 2022] DELETE /identity/v3/projects/983b3f0a085c45508d9a90a1b636a142 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:10.655813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.656104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.656384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.675120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:10.676305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:10.732856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1312/2597] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:10.741142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.741436 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.741731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.761285 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:10.762471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:10.770821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1286/2598] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:10.774957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.784845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea459662-5b1f-4414-b7b5-3e6b255dd52e None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.789446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.790098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.790377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.790648 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.791362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:10.791717 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.793407 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.805427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1313/2599] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:10.809657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.819706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bd7f8-e284-422a-aaa2-34f1ed5ec6fd None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.824429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.825125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.825412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.825684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.826373 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.828275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.853480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1287/2600] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:10 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:10.857422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.868085 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e70146-0fef-4fc9-90f8-a336b78c3bcc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.925598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.926263 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.926549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.926825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.927519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.929468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.949524 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1314/2601] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:10 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:10.953565 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.959090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:10.965604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca29def-9a1a-4754-923b-6354e662f68f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:10.971404 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:10.972054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:10.972354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:10.972625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:10.973374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:10.974988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:10.985280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1288/2602] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:10.989782 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:10.999912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f1920-b5ec-4240-bcf0-dcd2b20cad7d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:11.005548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb05d08-51d1-44d5-9e25-5c9788b82c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:11.006208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05d08-51d1-44d5-9e25-5c9788b82c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:11.006497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05d08-51d1-44d5-9e25-5c9788b82c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:11.006777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb05d08-51d1-44d5-9e25-5c9788b82c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:11.007497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb05d08-51d1-44d5-9e25-5c9788b82c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:11.009133 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb05d08-51d1-44d5-9e25-5c9788b82c9d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:11.019346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1315/2603] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:11.023386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:11.033250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b72dff-b67d-401d-aa8f-4529ee4f95a8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:11.038111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:11.038982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:11.039260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:11.039532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] PATH_INFO: `/v3/projects/a23d27fda8634ad883fd5fd6c92c643b/users/6bd44e2e940d4ce98d1d591586d10666/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:11.054631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23d27fda8634ad883fd5fd6c92c643b, user_id=6bd44e2e940d4ce98d1d591586d10666, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:11.057257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:11.070402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1289/2604] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:11 2022] PUT /identity/v3/projects/a23d27fda8634ad883fd5fd6c92c643b/users/6bd44e2e940d4ce98d1d591586d10666/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:11.080204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:11.080762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:11.080886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:11.107559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] MFA Rules not processed for user `6bd44e2e940d4ce98d1d591586d10666`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:11.108775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:11.163787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:11.175364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1316/2605] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:11.186659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:11.188388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:11.244480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696be8-b9cf-4d49-8b9e-454d47d01495 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:11.248512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:11.249193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:11.249475 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:11.249749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:11.258837 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:11.260271 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:11.269329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1290/2606] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:12.460759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:12.462209 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:12.519566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f9438-943a-4e0f-9769-d1367eb4f9fa None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:12.523720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:12.524385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:12.524746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:12.525079 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:12.527075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:12.585353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:12.586793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5fa8-245a-4054-b7bc-0f7118b69b55 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:12.595774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1317/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:18.394293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:18.491639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c151360-fa1c-4c6b-9073-69dc7217db1f service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:18.497592 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:18.499178 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:18.499677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:18.503522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] PATH_INFO: `/v3/users/6bd44e2e940d4ce98d1d591586d10666` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:18.504958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd44e2e940d4ce98d1d591586d10666)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:18.506970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:18.580626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd44e2e940d4ce98d1d591586d10666'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:18.594318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd44e2e940d4ce98d1d591586d10666'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:18.603494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:18.606494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd44e2e940d4ce98d1d591586d10666'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:18.607953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd44e2e940d4ce98d1d591586d10666'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:18.631090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd44e2e940d4ce98d1d591586d10666'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:18.642195 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1291/2608] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:18 2022] DELETE /identity/v3/users/6bd44e2e940d4ce98d1d591586d10666 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:18.647102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:18.647556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:18.647658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:18.667144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:18.668349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:18.729272 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1318/2609] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:18.738955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:18.740364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:18.801504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d5e53-bd63-4526-bb38-b724ae728f14 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:18.805629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:18.806287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:18.806573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:18.806848 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:18.816558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:18.818045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:18.829657 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1292/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:19.121400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:19.122831 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:19.135536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14faf15-2934-4c3c-99f4-fe6e3a3346a3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:19.140149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:19.141045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:19.141329 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:19.141619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] PATH_INFO: `/v3/projects/a23d27fda8634ad883fd5fd6c92c643b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:19.142880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23d27fda8634ad883fd5fd6c92c643b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:19.145166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:19.188128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:19.192618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23d27fda8634ad883fd5fd6c92c643b', 'request_id': 'req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:19.198883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23d27fda8634ad883fd5fd6c92c643b', 'request_id': 'req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:19.205567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23d27fda8634ad883fd5fd6c92c643b', 'request_id': 'req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:19.217545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] The token cache is being invalidate because project a23d27fda8634ad883fd5fd6c92c643b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:19.217833 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:19.218468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:19.220039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1319/2611] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:19 2022] DELETE /identity/v3/projects/a23d27fda8634ad883fd5fd6c92c643b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:19.832786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:19.835035 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:19.852551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b98610-9dc3-4dbe-895b-f63eca7aaf09 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:19.906944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:19.907604 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:19.907890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:19.908243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:19.910111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:19.975609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:19.977197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:19.987589 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1293/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:21.048213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:21.049909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:21.068652 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6abb8-d88e-4993-84b6-4e1a3e66a855 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:21.073605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:21.074567 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:21.075128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:21.075624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:21.078077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:21.096103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:21.098773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:21.115608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1320/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:24.993590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:24.995672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:25.061788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:25.083829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:25.087507 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:25.107130 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26b053-8335-489e-b60d-737513eae4c1 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:25.108148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf028ea-3f37-46d4-8b61-a9d738686ea8 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:25.115324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:25.116456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.116802 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.117192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] PATH_INFO: `/v3/users/a3792881ae73408db651dd6eb09b3d25` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.118576 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3792881ae73408db651dd6eb09b3d25)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:25.118958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:25.120039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.120392 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.120736 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.120890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:25.123040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:25.137695 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:25.139805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:25.153114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1294/2614] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:25.205218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3792881ae73408db651dd6eb09b3d25'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.225006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3792881ae73408db651dd6eb09b3d25'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.236594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3792881ae73408db651dd6eb09b3d25'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.237604 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3792881ae73408db651dd6eb09b3d25'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.250556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-92783cde-1ba9-428d-864e-e9623b6add0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3792881ae73408db651dd6eb09b3d25'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.269395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1321/2615] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:25 2022] DELETE /identity/v3/users/a3792881ae73408db651dd6eb09b3d25 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:25.542381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:25.557339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960ae41-dce8-4160-9c85-c46ef8deccc2 service placement] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:25.633250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:25.635793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.636223 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.636611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] PATH_INFO: `/v3/projects/9c5fb5bc86604f38b5f0f3a46525189a` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.639551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5fb5bc86604f38b5f0f3a46525189a)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:25.642854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:25.723951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5fb5bc86604f38b5f0f3a46525189a', 'request_id': 'req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.732442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5fb5bc86604f38b5f0f3a46525189a', 'request_id': 'req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.744220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5fb5bc86604f38b5f0f3a46525189a', 'request_id': 'req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.776317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] The token cache is being invalidate because project 9c5fb5bc86604f38b5f0f3a46525189a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:25.776611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.777614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e6c5fcbf-d36c-481b-8bb1-becef78e16d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:25.785327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1295/2616] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:25 2022] DELETE /identity/v3/projects/9c5fb5bc86604f38b5f0f3a46525189a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:25.790130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.790680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.790963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.819881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:25.821145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:25.891668 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1322/2617] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:25.899912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.900891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.901237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.929724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:25.930943 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:25.939989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1296/2618] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:25.944055 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:25.954248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724997-40af-4e11-9e2e-3c616554ca2a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:25.959384 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:25.959882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.960167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.961305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.961305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:25.961565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:25.963339 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:25.976548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1323/2619] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:25.981337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:25.991909 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbc9b-97fb-4002-aebe-ac7afa998ce6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:25.996856 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:25.997548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:25.998064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:25.998374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:25.999122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.001685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:26.032454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1297/2620] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:26.038280 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:26.048720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2f522-668f-4845-b154-6038d63d6707 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:26.061801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:26.111684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:26.112497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.112776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.113088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.113789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.116008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:26.138860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1324/2621] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:26 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:26.144123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:26.155414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796cb8-64d9-40f0-a0ad-fa0c0a1b7e7c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:26.160241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:26.161390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.161678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.161954 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.162698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.164348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:26.177662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1298/2622] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:26.181895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:26.193279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a375ea3-f29c-48d8-b899-d9bbb2f45048 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:26.198221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dd2fb-2dc5-479d-8480-c5381d5f74d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:26.199142 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd2fb-2dc5-479d-8480-c5381d5f74d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.199431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd2fb-2dc5-479d-8480-c5381d5f74d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.199704 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dd2fb-2dc5-479d-8480-c5381d5f74d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.200616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dd2fb-2dc5-479d-8480-c5381d5f74d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.202321 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dd2fb-2dc5-479d-8480-c5381d5f74d4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:26.214661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1325/2623] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:26.219082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:26.230163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea784da-d140-49ed-90c8-bb2731959774 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:26.235643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:26.236868 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.237479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.237479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] PATH_INFO: `/v3/projects/e74557ea7f0f4057b190c0adaaa80ed9/users/0e12538a6dd44bdd963e9850c24c04bc/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.263793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74557ea7f0f4057b190c0adaaa80ed9, user_id=0e12538a6dd44bdd963e9850c24c04bc, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.266710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:26.275724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:26.282122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1299/2624] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:26 2022] PUT /identity/v3/projects/e74557ea7f0f4057b190c0adaaa80ed9/users/0e12538a6dd44bdd963e9850c24c04bc/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:26.287790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.288086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.288372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.307821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:26.309169 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:26.374927 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1326/2625] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:26.385599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:26.387321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:26.448440 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832449c-6763-46ed-a073-addce692ef00 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:26.452039 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da48c70-65c8-4669-acfb-41b753279bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:26.452682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da48c70-65c8-4669-acfb-41b753279bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.452990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da48c70-65c8-4669-acfb-41b753279bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.453263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da48c70-65c8-4669-acfb-41b753279bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.463803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da48c70-65c8-4669-acfb-41b753279bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.465292 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da48c70-65c8-4669-acfb-41b753279bd2 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:26.474774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1300/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:01:26.924829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:26.926367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:26.940192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf244-41f2-4aee-9c76-3b1acb24b826 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:26.956165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:26.957499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:26.957791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:26.958075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] PATH_INFO: `/v3/users/9a3a0d79ebab412a9a0aa30edc47c8c6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:26.959646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3a0d79ebab412a9a0aa30edc47c8c6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:26.961746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:27.052016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3a0d79ebab412a9a0aa30edc47c8c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.067376 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3a0d79ebab412a9a0aa30edc47c8c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.075346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3a0d79ebab412a9a0aa30edc47c8c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.076549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3a0d79ebab412a9a0aa30edc47c8c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.091444 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3a0d79ebab412a9a0aa30edc47c8c6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.101580 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1327/2627] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:26 2022] DELETE /identity/v3/users/9a3a0d79ebab412a9a0aa30edc47c8c6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:27.105866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:27.106739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:27.107187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:27.127735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:27.129208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:27.203984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1301/2628] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:27.219192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:27.222155 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:27.238961 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:27.328494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c981c2-a789-413e-9541-8c456cdb021b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:27.333950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:27.334895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:27.335463 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:27.335974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:27.362117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:27.364492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:27.378373 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1328/2629] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:27.575981 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:27.577615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:27.592150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48541b4-d98a-42c4-b2ca-99c10fa5ae26 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:27.598898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:27.600841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:27.601385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:27.601871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] PATH_INFO: `/v3/users/7a4b471d14044069a5969e8bc6ca4f2d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:27.603716 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4b471d14044069a5969e8bc6ca4f2d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:27.606749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:27.668951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4b471d14044069a5969e8bc6ca4f2d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.687407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4b471d14044069a5969e8bc6ca4f2d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.698146 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4b471d14044069a5969e8bc6ca4f2d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.698902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4b471d14044069a5969e8bc6ca4f2d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.708874 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4b471d14044069a5969e8bc6ca4f2d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:27.717968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1302/2630] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:27 2022] DELETE /identity/v3/users/7a4b471d14044069a5969e8bc6ca4f2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:27.924159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:27.941412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedc113-1559-4390-b30a-f8d250ab7598 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:28.020629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:28.021820 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:28.022168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:28.022601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] PATH_INFO: `/v3/projects/3429e99ac2a94266b152e053bc6a0006` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:28.024121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3429e99ac2a94266b152e053bc6a0006)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:28.026731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:28.065161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:28.066605 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:28.082122 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefed4d-290d-4584-bdf2-12cea2d76bb0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:28.097821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:28.101541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3429e99ac2a94266b152e053bc6a0006', 'request_id': 'req-e7d3b99f-6db8-43f0-bb10-120af582f8ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.111122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3429e99ac2a94266b152e053bc6a0006', 'request_id': 'req-e7d3b99f-6db8-43f0-bb10-120af582f8ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.121781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3429e99ac2a94266b152e053bc6a0006', 'request_id': 'req-e7d3b99f-6db8-43f0-bb10-120af582f8ba'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.139457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] The token cache is being invalidate because project 3429e99ac2a94266b152e053bc6a0006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:28.139821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.140735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.144842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1329/2631] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:27 2022] DELETE /identity/v3/projects/3429e99ac2a94266b152e053bc6a0006 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:28.148722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:28.150679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:28.178443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:28.179986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:28.180433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:28.180870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] PATH_INFO: `/v3/projects/caf9dae8e8e9436b84ae6a642b9311c8` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:28.183059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf9dae8e8e9436b84ae6a642b9311c8)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:28.186249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:28.215867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:28.246988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3b99f-6db8-43f0-bb10-120af582f8ba admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:28.259665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf9dae8e8e9436b84ae6a642b9311c8', 'request_id': 'req-80f63cb9-c970-4f9c-8d72-52ee4dda8736'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.265683 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf9dae8e8e9436b84ae6a642b9311c8', 'request_id': 'req-80f63cb9-c970-4f9c-8d72-52ee4dda8736'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.277030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf9dae8e8e9436b84ae6a642b9311c8', 'request_id': 'req-80f63cb9-c970-4f9c-8d72-52ee4dda8736'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.296563 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] The token cache is being invalidate because project caf9dae8e8e9436b84ae6a642b9311c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:28.297013 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.297846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.302732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1303/2632] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:28 2022] DELETE /identity/v3/projects/caf9dae8e8e9436b84ae6a642b9311c8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:28.303813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:28.306073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:28.324796 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:28.325848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:28.326080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:28.326398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] PATH_INFO: `/v3/users/877d90edfc1a495f80ee6cef978a077b` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:28.327872 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] RBAC: Authorizing `identity:delete_user(user_id=877d90edfc1a495f80ee6cef978a077b)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:28.330120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:28.411102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877d90edfc1a495f80ee6cef978a077b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.422334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f63cb9-c970-4f9c-8d72-52ee4dda8736 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:28.441184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877d90edfc1a495f80ee6cef978a077b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.447461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:28.449845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:28.449845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:28.449845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] PATH_INFO: `/v3/users/52f1feac57f8416dba221f71ce3b674f` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:28.460606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f1feac57f8416dba221f71ce3b674f)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:28.462379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877d90edfc1a495f80ee6cef978a077b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.463240 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877d90edfc1a495f80ee6cef978a077b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.463739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:28.474478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877d90edfc1a495f80ee6cef978a077b'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.483756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1330/2633] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:28 2022] DELETE /identity/v3/users/877d90edfc1a495f80ee6cef978a077b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:28.554614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:28.557210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f1feac57f8416dba221f71ce3b674f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.574858 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f1feac57f8416dba221f71ce3b674f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.585780 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f1feac57f8416dba221f71ce3b674f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.587650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f1feac57f8416dba221f71ce3b674f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.598876 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f1feac57f8416dba221f71ce3b674f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:28.606458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1304/2634] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:28 2022] DELETE /identity/v3/users/52f1feac57f8416dba221f71ce3b674f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:28.945793 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:28.947626 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:29.077427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aadc250-1fd0-4ae4-81cc-0761335f700c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.084759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.086478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:29.091643 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:29.178319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.178319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.178319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.178319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] PATH_INFO: `/v3/projects/4bc58de9b36642a096ddde216d1f490f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.179609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc58de9b36642a096ddde216d1f490f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.181780 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.196531 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15451c-8db4-4997-b409-5dbba592343e admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.208291 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.209302 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.209633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.213046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] PATH_INFO: `/v3/projects/8c9b532b06964327a0c7764db64edcba` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.214094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9b532b06964327a0c7764db64edcba)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.217421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.253865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc58de9b36642a096ddde216d1f490f', 'request_id': 'req-b00528f0-7a38-4c10-95fe-39de8bdc3226'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.261538 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc58de9b36642a096ddde216d1f490f', 'request_id': 'req-b00528f0-7a38-4c10-95fe-39de8bdc3226'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.269215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc58de9b36642a096ddde216d1f490f', 'request_id': 'req-b00528f0-7a38-4c10-95fe-39de8bdc3226'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.286684 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] The token cache is being invalidate because project 4bc58de9b36642a096ddde216d1f490f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:29.287493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.288451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-b00528f0-7a38-4c10-95fe-39de8bdc3226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.290459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9b532b06964327a0c7764db64edcba', 'request_id': 'req-88957a71-76ab-4ada-b4c2-d9b4172cb882'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.291053 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1331/2635] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:28 2022] DELETE /identity/v3/projects/4bc58de9b36642a096ddde216d1f490f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:29.303841 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9b532b06964327a0c7764db64edcba', 'request_id': 'req-88957a71-76ab-4ada-b4c2-d9b4172cb882'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.315403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9b532b06964327a0c7764db64edcba', 'request_id': 'req-88957a71-76ab-4ada-b4c2-d9b4172cb882'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.331813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] The token cache is being invalidate because project 8c9b532b06964327a0c7764db64edcba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:29.332361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.333286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-88957a71-76ab-4ada-b4c2-d9b4172cb882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:29.336663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1305/2636] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:29 2022] DELETE /identity/v3/projects/8c9b532b06964327a0c7764db64edcba => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:29.342121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.342671 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.343057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.385670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:29.388789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:29.525887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1332/2637] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:29.538001 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.538579 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.539031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.567188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:29.570019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:29.591197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1306/2638] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:29.596768 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.608541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0da45-77be-44df-8f12-028dc9127575 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.614819 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.615490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.615771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.616046 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.616912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:29.617259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.619067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.634761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1333/2639] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:29.639685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.650950 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e093d8-6222-4929-ae14-c50954d144f6 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.655626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.656871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.657193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.657627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.658360 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.660735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.695023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1307/2640] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:29 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:29.699611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.712348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c5005-6ff9-4c05-9f9d-9550230bef6c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.748336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:29.792584 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.793880 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.794344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.794772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.795750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.797874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.829212 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1334/2641] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:29 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:29.830722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.842343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6139d8-4bcd-4fdb-9099-ee9076950c13 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.848767 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.849883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.849883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.850094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.850812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.852437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.867982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1308/2642] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:29.869320 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.880645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccb8c0-5589-4da3-a394-d0688f19e92c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.885549 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cbf69-0b71-4c63-a981-ff55dd540d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.886226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cbf69-0b71-4c63-a981-ff55dd540d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.886568 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cbf69-0b71-4c63-a981-ff55dd540d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.886767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cbf69-0b71-4c63-a981-ff55dd540d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.887491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cbf69-0b71-4c63-a981-ff55dd540d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.889250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cbf69-0b71-4c63-a981-ff55dd540d28 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.904454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1335/2643] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:29.905741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:29.919096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a31c5-09ca-4e61-9755-c41d942d1103 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:29.925340 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:29.926320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.927005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.927005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] PATH_INFO: `/v3/projects/79673854ec804ede9ae7103141e92aca/users/bb6424e76b314f49855bbdf1dd29bc77/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:29.941307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:29.948370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79673854ec804ede9ae7103141e92aca, user_id=bb6424e76b314f49855bbdf1dd29bc77, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:29.952739 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:29.972747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1309/2644] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:29 2022] PUT /identity/v3/projects/79673854ec804ede9ae7103141e92aca/users/bb6424e76b314f49855bbdf1dd29bc77/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:29.984865 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:29.985186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:29.985470 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.017337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] MFA Rules not processed for user `bb6424e76b314f49855bbdf1dd29bc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:30.018839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:30.111286 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.117540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1336/2645] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:30.188386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e21c9-ac9f-46ce-866a-a9a5360dd542 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.193396 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.194220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.194587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.195062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.195857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.197958 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.233191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.233844 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1310/2646] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:30 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:30.245486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0c45d-9966-42bf-a4cd-2f2fd3339681 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.314534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.315215 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.315638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.315986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.316753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.318841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.349422 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1337/2647] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:30 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:01:30.357712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.380187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c262af4-bec9-429a-9574-a75ba6825115 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.391384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.394494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.394494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.394494 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.395227 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.396947 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.414492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1311/2648] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:30.415116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.430034 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746e038-b1e7-4b10-8ecf-79381923d47c admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.437268 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.438298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.439895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.440565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] PATH_INFO: `/v3/projects/c3993c8b78f9491dbc686283696293e8/users/89bf7acce03e466db8d5c56fcbe688c4/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.461419 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3993c8b78f9491dbc686283696293e8, user_id=89bf7acce03e466db8d5c56fcbe688c4, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.464912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.494630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.495088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1338/2649] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:30 2022] PUT /identity/v3/projects/c3993c8b78f9491dbc686283696293e8/users/89bf7acce03e466db8d5c56fcbe688c4/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:30.510928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaffb9-3566-45dd-975c-1da317ee4fd3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.618089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8981e-a289-4d1c-9e35-fa7409bd4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.618785 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8981e-a289-4d1c-9e35-fa7409bd4d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.619070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8981e-a289-4d1c-9e35-fa7409bd4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.620082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8981e-a289-4d1c-9e35-fa7409bd4d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.620581 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8981e-a289-4d1c-9e35-fa7409bd4d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.622457 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8981e-a289-4d1c-9e35-fa7409bd4d41 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.642675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.645056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1312/2650] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:30.661937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39008a-6fee-4bff-9896-6707f9aff1e6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.679711 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.680699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.681699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.682608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] PATH_INFO: `/v3/projects/c3993c8b78f9491dbc686283696293e8/users/89bf7acce03e466db8d5c56fcbe688c4/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.686551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3993c8b78f9491dbc686283696293e8, user_id=89bf7acce03e466db8d5c56fcbe688c4, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.690325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.693964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:30.705157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1339/2651] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:30 2022] PUT /identity/v3/projects/c3993c8b78f9491dbc686283696293e8/users/89bf7acce03e466db8d5c56fcbe688c4/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:30.715497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.715795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.716148 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.747946 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] MFA Rules not processed for user `89bf7acce03e466db8d5c56fcbe688c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:30.749222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:30.815156 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:30.843006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1313/2652] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:30.857640 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:30.859853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:30.941809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae5a8-9405-44a7-b8db-9586ff794a93 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:30.946747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427751d-8765-4a7e-a3f3-ebbd3db5ff57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:30.947486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427751d-8765-4a7e-a3f3-ebbd3db5ff57 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:30.947847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427751d-8765-4a7e-a3f3-ebbd3db5ff57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:30.948220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427751d-8765-4a7e-a3f3-ebbd3db5ff57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:30.958762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427751d-8765-4a7e-a3f3-ebbd3db5ff57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:30.960336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427751d-8765-4a7e-a3f3-ebbd3db5ff57 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:30.971252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1340/2653] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:31.059681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:31.073143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a94a58-9290-4a6c-a284-5290cbf9d73f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:31.077588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:31.078378 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:31.078544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:31.078800 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:31.161470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:31.161470 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:31.171750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1314/2654] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:31.295495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7be314-e8e6-42df-b025-2bc953ba7b3d None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:31.295855 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7be314-e8e6-42df-b025-2bc953ba7b3d None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:31.296136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7be314-e8e6-42df-b025-2bc953ba7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:31.342683 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-df7be314-e8e6-42df-b025-2bc953ba7b3d None None] MFA Rules not processed for user `0e12538a6dd44bdd963e9850c24c04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:31.343966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-df7be314-e8e6-42df-b025-2bc953ba7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:31.429344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1341/2655] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:31.445784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:31.447501 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:31.555111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be912cfb-0f3b-4230-98bf-2df88f24ebef service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:31.560540 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:31.561731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:31.561854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:31.562026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:31.573894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:31.575545 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:31.586042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1315/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:32.961554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316bcf7-9fbb-41fa-a9da-d53a9b7b55f9 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:32.962088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316bcf7-9fbb-41fa-a9da-d53a9b7b55f9 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:32.962088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316bcf7-9fbb-41fa-a9da-d53a9b7b55f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:32.981408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9316bcf7-9fbb-41fa-a9da-d53a9b7b55f9 None None] MFA Rules not processed for user `0e12538a6dd44bdd963e9850c24c04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:32.983006 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9316bcf7-9fbb-41fa-a9da-d53a9b7b55f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:32.990843 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1342/2657] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:40.652260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:40.715725 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cc78-bcec-4900-88e9-828b35d731f4 service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:40.721081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:40.721953 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:40.722237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:40.722513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] PATH_INFO: `/v3/users/bb6424e76b314f49855bbdf1dd29bc77` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:40.723699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6424e76b314f49855bbdf1dd29bc77)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:40.725682 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:40.736511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:40.775632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6424e76b314f49855bbdf1dd29bc77'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:40.788768 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6424e76b314f49855bbdf1dd29bc77'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:40.798387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6424e76b314f49855bbdf1dd29bc77'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:40.799123 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6424e76b314f49855bbdf1dd29bc77'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:40.806945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6424e76b314f49855bbdf1dd29bc77'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:40.813961 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1316/2658] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:40 2022] DELETE /identity/v3/users/bb6424e76b314f49855bbdf1dd29bc77 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:40.818781 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:40.819284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:40.819406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:40.838136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:40.839359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:40.901091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1343/2659] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:40.911212 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:40.912611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:40.970063 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717faa27-6922-4316-b1d4-a1e9aa72196c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:40.973763 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:40.974411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:40.974698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:40.974983 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:40.984012 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:40.985834 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:40.995327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1317/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:41.260962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:41.262471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:41.275539 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f22463-ab34-43ba-8cc9-5a2fce876c55 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:41.280526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:41.281427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:41.282734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:41.283336 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] PATH_INFO: `/v3/projects/79673854ec804ede9ae7103141e92aca` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:41.284746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] RBAC: Authorizing `identity:delete_project(project_id=79673854ec804ede9ae7103141e92aca)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:41.287337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:41.305107 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:41.337412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79673854ec804ede9ae7103141e92aca', 'request_id': 'req-94041dcf-928c-404b-8129-75c140bf75df'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.343162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79673854ec804ede9ae7103141e92aca', 'request_id': 'req-94041dcf-928c-404b-8129-75c140bf75df'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.349543 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79673854ec804ede9ae7103141e92aca', 'request_id': 'req-94041dcf-928c-404b-8129-75c140bf75df'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.361540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] The token cache is being invalidate because project 79673854ec804ede9ae7103141e92aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:41.361828 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.362499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.364090 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1344/2661] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:41 2022] DELETE /identity/v3/projects/79673854ec804ede9ae7103141e92aca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:41.368043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:41.378222 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65ec9a-6a2f-4c75-a469-3986c4ec0029 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:41.435315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:41.436120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:41.436402 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:41.436673 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] PATH_INFO: `/v3/users/89bf7acce03e466db8d5c56fcbe688c4` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:41.437884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89bf7acce03e466db8d5c56fcbe688c4)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:41.440641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:41.474477 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:41.489041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89bf7acce03e466db8d5c56fcbe688c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.501851 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89bf7acce03e466db8d5c56fcbe688c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.508633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89bf7acce03e466db8d5c56fcbe688c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.509307 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89bf7acce03e466db8d5c56fcbe688c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.516989 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ffcb81ae-e248-45c8-955c-d7a6256d2d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89bf7acce03e466db8d5c56fcbe688c4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.523511 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1318/2662] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:41 2022] DELETE /identity/v3/users/89bf7acce03e466db8d5c56fcbe688c4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:41.792752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:41.794291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:41.808238 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041dcf-928c-404b-8129-75c140bf75df admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:41.866573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:41.867438 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:41.867753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:41.868031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] PATH_INFO: `/v3/projects/c3993c8b78f9491dbc686283696293e8` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:41.869267 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3993c8b78f9491dbc686283696293e8)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:41.871185 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:41.924346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3993c8b78f9491dbc686283696293e8', 'request_id': 'req-0287972c-3e5b-4ce8-a0df-83f30a263e57'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.931823 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3993c8b78f9491dbc686283696293e8', 'request_id': 'req-0287972c-3e5b-4ce8-a0df-83f30a263e57'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.938307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3993c8b78f9491dbc686283696293e8', 'request_id': 'req-0287972c-3e5b-4ce8-a0df-83f30a263e57'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.952054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] The token cache is being invalidate because project c3993c8b78f9491dbc686283696293e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:41.952345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.952999 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0287972c-3e5b-4ce8-a0df-83f30a263e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:41.954620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1345/2663] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:41 2022] DELETE /identity/v3/projects/c3993c8b78f9491dbc686283696293e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:41.959702 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:41.960273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:41.960273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:41.981955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:41.983183 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:42.057779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1319/2664] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:42.067009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.067398 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.067824 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.090277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:42.091545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:42.103624 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1346/2665] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:42.104911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.115269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c18db-a852-49e6-9dff-fe361eacbc3a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.120453 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.121144 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.121429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.121701 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.122433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:42.122738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.124347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.138228 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1320/2666] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:42.143658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.153269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4566c4a-6562-41a7-b1ce-e23a5e929c60 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.158078 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.158845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.159201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.159566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.160359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.162297 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.192068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1347/2667] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:42.193547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.204513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4feff-ebbf-4e0f-ba0e-605b899736a0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.267354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.268284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.268564 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.268838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.269556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.271497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.293566 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1321/2668] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:42.295287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.302340 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:42.306457 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb510ba-ce78-4f2b-8e46-caa6717fcd33 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.312599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.313847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.314167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.314613 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.315368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.317197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.327708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1348/2669] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:42.332819 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.342686 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97762-2e9e-4136-acb5-cba9b26360b1 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.347820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1a7a-d128-45a1-b15b-f560f0a0d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.348467 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1a7a-d128-45a1-b15b-f560f0a0d812 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.348746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1a7a-d128-45a1-b15b-f560f0a0d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.349057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1a7a-d128-45a1-b15b-f560f0a0d812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.349770 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1a7a-d128-45a1-b15b-f560f0a0d812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.351346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1a7a-d128-45a1-b15b-f560f0a0d812 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.361771 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1322/2670] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:42.365713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.375857 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b811a-ec1b-42dc-b109-294d7e3a315d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.380556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.381499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.381791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.382067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] PATH_INFO: `/v3/projects/898f0d594de3435892d5d3e396049432/users/35c4f18b432c4909a0d1d8851c6bd16e/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.397550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898f0d594de3435892d5d3e396049432, user_id=35c4f18b432c4909a0d1d8851c6bd16e, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.400221 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.413516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1349/2671] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:42 2022] PUT /identity/v3/projects/898f0d594de3435892d5d3e396049432/users/35c4f18b432c4909a0d1d8851c6bd16e/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:42.424889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.425215 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.425497 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.453100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] MFA Rules not processed for user `35c4f18b432c4909a0d1d8851c6bd16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:42.454928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:42.459024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:42.533205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1323/2672] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:42.534338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.600625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3efcf-2365-40fc-83d2-53d567eada01 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.605522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.606206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.606492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.606772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.607475 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.609595 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.637334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1350/2673] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:42.641047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.652653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267260a7-e45e-4fee-862c-fec947f38ec0 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.708391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.709093 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.709381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.709659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.710339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.712265 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.732153 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1324/2674] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:42.736159 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.746435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4663a-f0a4-4b26-bc1b-72fd0a384124 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.751680 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.752332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.752617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.752895 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.753651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.755250 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.767374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1351/2675] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:42.771653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.782181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be39003-1f43-4fdc-9782-b7381c2388a2 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.786788 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.787659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.787940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.788213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] PATH_INFO: `/v3/projects/82e479a79aca4a3ab66a014d18c645d3/users/137b8c16e75c46f786b1b0de4c8d30cd/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.802904 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e479a79aca4a3ab66a014d18c645d3, user_id=137b8c16e75c46f786b1b0de4c8d30cd, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.805591 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.818684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1325/2676] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:42 2022] PUT /identity/v3/projects/82e479a79aca4a3ab66a014d18c645d3/users/137b8c16e75c46f786b1b0de4c8d30cd/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:42.822664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.833327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89c94a-ff47-44fd-9680-e96e84245534 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.892898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd001-65ea-47be-90da-65e8e8500b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.893821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd001-65ea-47be-90da-65e8e8500b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.894222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd001-65ea-47be-90da-65e8e8500b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.894582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd001-65ea-47be-90da-65e8e8500b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.895391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd001-65ea-47be-90da-65e8e8500b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.897202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd001-65ea-47be-90da-65e8e8500b89 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.907497 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1352/2677] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:42.911641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:42.923536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946af2-43ce-41d4-b43d-100c0c95c09e admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:42.929306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:42.930229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.930516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.930791 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] PATH_INFO: `/v3/projects/82e479a79aca4a3ab66a014d18c645d3/users/137b8c16e75c46f786b1b0de4c8d30cd/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.932924 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e479a79aca4a3ab66a014d18c645d3, user_id=137b8c16e75c46f786b1b0de4c8d30cd, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:42.935646 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:42.955472 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1326/2678] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:42 2022] PUT /identity/v3/projects/82e479a79aca4a3ab66a014d18c645d3/users/137b8c16e75c46f786b1b0de4c8d30cd/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:42.965480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:42.965777 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:42.966061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:42.993804 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] MFA Rules not processed for user `137b8c16e75c46f786b1b0de4c8d30cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:42.995140 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:43.025882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:43.069458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1353/2679] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:43.082252 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:43.084096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:43.152633 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1ba2-b937-4d5b-b355-65bd6ec23794 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:43.156354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:43.157600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:43.157879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:43.158151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:43.167792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:43.169267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:43.174239 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:43.180177 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1327/2680] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:43.491759 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:43.502048 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e8206-d7e8-46bf-bdc0-7d85ddcb3a0f None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:43.506691 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137b8c16e75c46f786b1b0de4c8d30cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e479a79aca4a3ab66a014d18c645d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:43.507346 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:43.507635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:43.507947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:43.508672 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:43.509010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:43.510619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:43.523669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1354/2681] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:43.528303 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:43.539040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac71929-a6bf-487c-ac7a-b38b9a5d4a50 service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:43.543615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137b8c16e75c46f786b1b0de4c8d30cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e479a79aca4a3ab66a014d18c645d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:43.544260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:43.544553 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:43.544831 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:43.545550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:43.547922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:43.572880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1328/2682] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:43 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:43.576924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:43.587499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58573d67-85f9-4931-84de-fe7c807a5f19 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:43.645412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137b8c16e75c46f786b1b0de4c8d30cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e479a79aca4a3ab66a014d18c645d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:43.646076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:43.646370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:43.646660 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:43.647385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:43.647703 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:43.649345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:43.660548 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1355/2683] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:43.696000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:43.706620 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b14e5c-9589-49f9-9b71-ae3c242c6c13 tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:43.711175 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137b8c16e75c46f786b1b0de4c8d30cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82e479a79aca4a3ab66a014d18c645d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:43.712028 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:43.712314 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:43.712590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] PATH_INFO: `/v3/projects/0a6886cc2a4f4a1b91cdbb20e3ab36e8` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:43.713796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a6886cc2a4f4a1b91cdbb20e3ab36e8)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:43.715688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:43.761663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6886cc2a4f4a1b91cdbb20e3ab36e8', 'request_id': 'req-b06de24d-7bad-45cb-8bc0-78210ba2873f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:43.767893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6886cc2a4f4a1b91cdbb20e3ab36e8', 'request_id': 'req-b06de24d-7bad-45cb-8bc0-78210ba2873f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:43.776520 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6886cc2a4f4a1b91cdbb20e3ab36e8', 'request_id': 'req-b06de24d-7bad-45cb-8bc0-78210ba2873f'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:43.788743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] The token cache is being invalidate because project 0a6886cc2a4f4a1b91cdbb20e3ab36e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:43.789055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:43.789691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b06de24d-7bad-45cb-8bc0-78210ba2873f tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:43.791319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1329/2684] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:43 2022] DELETE /identity/v3/projects/0a6886cc2a4f4a1b91cdbb20e3ab36e8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:43.981803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:43.984035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:44.052904 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea759415-6994-4fb7-b1ae-332e5357f9af tempest-VolumeQuotaClassesTest-242742096 tempest-VolumeQuotaClassesTest-242742096-project-admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:44.110458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=100 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:44.120047 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:44.120948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:44.121256 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:44.121541 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] PATH_INFO: `/v3/users/35c4f18b432c4909a0d1d8851c6bd16e` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:44.122774 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c4f18b432c4909a0d1d8851c6bd16e)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:44.124747 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:44.178063 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c4f18b432c4909a0d1d8851c6bd16e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.191598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c4f18b432c4909a0d1d8851c6bd16e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.198611 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c4f18b432c4909a0d1d8851c6bd16e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.199382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c4f18b432c4909a0d1d8851c6bd16e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.207226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c4f18b432c4909a0d1d8851c6bd16e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.213544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1356/2685] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:43 2022] DELETE /identity/v3/users/35c4f18b432c4909a0d1d8851c6bd16e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:44.218327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:44.218826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:44.218928 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:44.239019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:44.240316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:44.306060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1330/2686] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:44.316226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:44.318181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:44.383930 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac91e14-8cb7-4dbd-8a17-96d7e727c19d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:44.387686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:44.388341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:44.388647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:44.388957 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:44.399916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:44.401395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:44.411887 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1357/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:44.692562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:44.693988 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:44.708316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6484e-52f1-4d3e-bf38-7e58f811f0cf None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:44.713752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:44.715690 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:44.715915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:44.716191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] PATH_INFO: `/v3/projects/898f0d594de3435892d5d3e396049432` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:44.717462 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898f0d594de3435892d5d3e396049432)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:44.719903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:44.778018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898f0d594de3435892d5d3e396049432', 'request_id': 'req-9309d382-39e7-41a9-8fc8-685970a9d841'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.782758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:44.784263 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898f0d594de3435892d5d3e396049432', 'request_id': 'req-9309d382-39e7-41a9-8fc8-685970a9d841'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.793849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898f0d594de3435892d5d3e396049432', 'request_id': 'req-9309d382-39e7-41a9-8fc8-685970a9d841'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.808024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] The token cache is being invalidate because project 898f0d594de3435892d5d3e396049432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:44.808306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.808951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.810755 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1331/2688] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:44 2022] DELETE /identity/v3/projects/898f0d594de3435892d5d3e396049432 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:44.815194 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:44.825073 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5f733-6990-4c4c-83e4-5413c506d232 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:44.883395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:44.884270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:44.884550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:44.884826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] PATH_INFO: `/v3/users/137b8c16e75c46f786b1b0de4c8d30cd` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:44.886028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=137b8c16e75c46f786b1b0de4c8d30cd)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:44.887956 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:44.904131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:44.936195 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '137b8c16e75c46f786b1b0de4c8d30cd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.949224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '137b8c16e75c46f786b1b0de4c8d30cd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.956120 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '137b8c16e75c46f786b1b0de4c8d30cd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.956791 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '137b8c16e75c46f786b1b0de4c8d30cd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.964458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6b02062a-0971-490c-8c4d-d54df2399c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '137b8c16e75c46f786b1b0de4c8d30cd'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:44.971412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1358/2689] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:44 2022] DELETE /identity/v3/users/137b8c16e75c46f786b1b0de4c8d30cd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:45.239840 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.241492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:45.255919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309d382-39e7-41a9-8fc8-685970a9d841 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.313894 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.314766 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.315053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.315333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] PATH_INFO: `/v3/projects/82e479a79aca4a3ab66a014d18c645d3` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.316517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e479a79aca4a3ab66a014d18c645d3)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.318490 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.365786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e479a79aca4a3ab66a014d18c645d3', 'request_id': 'req-95054228-e77c-493f-b385-9a35822f674c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:45.371268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e479a79aca4a3ab66a014d18c645d3', 'request_id': 'req-95054228-e77c-493f-b385-9a35822f674c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:45.378616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e479a79aca4a3ab66a014d18c645d3', 'request_id': 'req-95054228-e77c-493f-b385-9a35822f674c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:45.389473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] The token cache is being invalidate because project 82e479a79aca4a3ab66a014d18c645d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:45.389757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:45.390377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-95054228-e77c-493f-b385-9a35822f674c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:45.393031 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1332/2690] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:45 2022] DELETE /identity/v3/projects/82e479a79aca4a3ab66a014d18c645d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:45.397883 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.398382 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.398481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.417395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:45.418588 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:45.476807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1359/2691] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:45.484769 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.485226 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.485637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.504779 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:45.506016 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:45.514005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1333/2692] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:45.519415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.532858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217a6fb-7654-430c-85a6-56a90f0e38b2 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.537526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.538213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.538490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.538761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.539485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:45.539790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.541400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.553551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1360/2693] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:01:45.557829 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.568269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0c0e4-dd5d-41c5-a822-dee81f7aa520 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.572977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.573639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.573952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.574233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.574919 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.576824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.603938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1334/2694] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:45 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:45.608049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.619121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb837da-6126-4312-ba8b-9ed106ce4eb6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.681318 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.681989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.682274 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.682553 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.683235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.685178 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.705418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1361/2695] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:45 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:01:45.709596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.719726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c03e-d873-4345-8fd5-d4a6348766f0 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.724255 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.724892 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.725205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.725480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.726199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.727790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.738348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1335/2696] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:45.742124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.752477 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781678f1-fc70-48b1-a706-5b9d6dc035af admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.757255 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474432f-9b49-49e6-b3f1-e2d83e43b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.757907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474432f-9b49-49e6-b3f1-e2d83e43b434 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.758191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474432f-9b49-49e6-b3f1-e2d83e43b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.758468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474432f-9b49-49e6-b3f1-e2d83e43b434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.759184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474432f-9b49-49e6-b3f1-e2d83e43b434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.760832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474432f-9b49-49e6-b3f1-e2d83e43b434 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.766663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:45.777544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1362/2697] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:45.779931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:45.790617 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8389fc-461a-4498-86c1-2e6161db1eb6 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:45.795450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:45.796330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.796608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.796877 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] PATH_INFO: `/v3/projects/4b4c342e94634c89a4006bb7c215b4dd/users/8ef66cda60b84a779337cafea942d42d/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.811304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4c342e94634c89a4006bb7c215b4dd, user_id=8ef66cda60b84a779337cafea942d42d, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:45.814702 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:45.827644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1336/2698] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:45 2022] PUT /identity/v3/projects/4b4c342e94634c89a4006bb7c215b4dd/users/8ef66cda60b84a779337cafea942d42d/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:45.894072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:45.894437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:45.895028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:45.924074 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] MFA Rules not processed for user `8ef66cda60b84a779337cafea942d42d`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:45.925379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:45.992902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1363/2699] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:45.997334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.010740 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:46.061803 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b7ed-1a75-4c2c-b1a0-5de336edcd36 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.067495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.068147 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.068432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.068708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.069421 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.071318 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.095828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1337/2700] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:45 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:46.099978 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.111630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a65a8-c27a-4e93-a4f6-063afa1d419c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.168296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.169026 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.169312 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.169589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.170305 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.172754 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.192657 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1364/2701] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:46 2022] POST /identity/v3/users => generated 310 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:01:46.196588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.207597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6844b8-745f-4600-8cf1-9ee8b4afed90 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.212102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.212747 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.213070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.213347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.214080 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.215663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.227025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1338/2702] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:46.231056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.241514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3af24-18c8-4a57-ab28-03dbb67329af admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.246122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.246938 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.247222 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.247496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] PATH_INFO: `/v3/projects/09e743b0fb6e461dac859ee1bee15fd6/users/48cb746bc9594630af49908784405bd9/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.263197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e743b0fb6e461dac859ee1bee15fd6, user_id=48cb746bc9594630af49908784405bd9, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.265935 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.278658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1365/2703] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:46 2022] PUT /identity/v3/projects/09e743b0fb6e461dac859ee1bee15fd6/users/48cb746bc9594630af49908784405bd9/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:46.282590 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.292706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d258b-b219-4e01-b2d8-14003d5c104d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.354842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7829f1-39a9-4afc-b231-193ea1ef64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.355509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7829f1-39a9-4afc-b231-193ea1ef64f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.355794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7829f1-39a9-4afc-b231-193ea1ef64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.356072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7829f1-39a9-4afc-b231-193ea1ef64f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.356789 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7829f1-39a9-4afc-b231-193ea1ef64f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.358431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7829f1-39a9-4afc-b231-193ea1ef64f0 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.368922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1339/2704] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:46.373262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.384348 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733673d-ca55-4863-ade1-c9d1311f0e6a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.388871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.389767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.390049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.390322 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] PATH_INFO: `/v3/projects/09e743b0fb6e461dac859ee1bee15fd6/users/48cb746bc9594630af49908784405bd9/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.392388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e743b0fb6e461dac859ee1bee15fd6, user_id=48cb746bc9594630af49908784405bd9, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.395301 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.406049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1366/2705] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:46 2022] PUT /identity/v3/projects/09e743b0fb6e461dac859ee1bee15fd6/users/48cb746bc9594630af49908784405bd9/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:46.416743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.417070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.417353 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.443504 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] MFA Rules not processed for user `48cb746bc9594630af49908784405bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:46.444710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:46.516000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1340/2706] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:46.528266 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.529988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:46.577291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:46.590307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9435dc-4556-4912-a4cf-318541dca134 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.594491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.595234 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.595516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.595794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.604775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.606248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.616177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1367/2707] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:46.773689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:46.787412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0de4-c3f8-4c4e-88bd-580d30318367 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:46.791229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694042d-8148-4161-993c-33be1a7280e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:46.791871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694042d-8148-4161-993c-33be1a7280e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:46.792149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694042d-8148-4161-993c-33be1a7280e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:46.792423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694042d-8148-4161-993c-33be1a7280e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:46.796854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:46.854710 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694042d-8148-4161-993c-33be1a7280e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:46.856169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694042d-8148-4161-993c-33be1a7280e8 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:46.865640 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1341/2708] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:54.203307 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:54.265610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a4ef-82dd-4666-8e76-fd603c561cc7 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:54.270610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:54.271476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:54.271756 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:54.272031 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] PATH_INFO: `/v3/users/8ef66cda60b84a779337cafea942d42d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:54.273228 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef66cda60b84a779337cafea942d42d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:54.275132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:54.321202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef66cda60b84a779337cafea942d42d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.333362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef66cda60b84a779337cafea942d42d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.340139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef66cda60b84a779337cafea942d42d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.340798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef66cda60b84a779337cafea942d42d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.348235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef66cda60b84a779337cafea942d42d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.354096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1368/2709] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:54 2022] DELETE /identity/v3/users/8ef66cda60b84a779337cafea942d42d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:54.358653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:54.359654 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:54.359761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:54.381055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:54.382288 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:54.439820 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1342/2710] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:54.449493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:54.450903 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:54.507852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8cf25-05f7-417e-a48d-c1ccc936704f admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:54.511467 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:54.512106 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:54.512385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:54.512659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:54.524988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:54.526616 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:54.537119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1369/2711] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:54.810391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:54.811847 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:54.826976 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590eeba-ec5a-4da7-afde-b545ecf56255 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:54.833094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:54.833962 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:54.834324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:54.834496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] PATH_INFO: `/v3/projects/4b4c342e94634c89a4006bb7c215b4dd` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:54.835754 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4c342e94634c89a4006bb7c215b4dd)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:54.837614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:54.890705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4c342e94634c89a4006bb7c215b4dd', 'request_id': 'req-750eb134-c287-44d6-8235-ab49b51981c7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.896321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4c342e94634c89a4006bb7c215b4dd', 'request_id': 'req-750eb134-c287-44d6-8235-ab49b51981c7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.903615 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4c342e94634c89a4006bb7c215b4dd', 'request_id': 'req-750eb134-c287-44d6-8235-ab49b51981c7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.915400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] The token cache is being invalidate because project 4b4c342e94634c89a4006bb7c215b4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:54.915689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.916315 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:54.917887 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1343/2712] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:54 2022] DELETE /identity/v3/projects/4b4c342e94634c89a4006bb7c215b4dd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:54.922426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:54.932135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1f417-0e26-4adb-81d0-96126646cccc service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:54.935698 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:54.999937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.000900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.001218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.001500 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] PATH_INFO: `/v3/users/48cb746bc9594630af49908784405bd9` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.002697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cb746bc9594630af49908784405bd9)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.004623 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.057741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cb746bc9594630af49908784405bd9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.069557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cb746bc9594630af49908784405bd9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.076304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cb746bc9594630af49908784405bd9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.077005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cb746bc9594630af49908784405bd9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.084775 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-80e63d52-bb18-4848-b1c2-5700197d7929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cb746bc9594630af49908784405bd9'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.090739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1370/2713] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:54 2022] DELETE /identity/v3/users/48cb746bc9594630af49908784405bd9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:55.371011 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.372043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:55.385213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eb134-c287-44d6-8235-ab49b51981c7 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.413368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:55.446142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.446929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.447207 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.447480 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] PATH_INFO: `/v3/projects/09e743b0fb6e461dac859ee1bee15fd6` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.448634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e743b0fb6e461dac859ee1bee15fd6)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.450569 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.497495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e743b0fb6e461dac859ee1bee15fd6', 'request_id': 'req-1145e8b3-e02e-4545-9048-b0fcf1012432'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.502898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e743b0fb6e461dac859ee1bee15fd6', 'request_id': 'req-1145e8b3-e02e-4545-9048-b0fcf1012432'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.510897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e743b0fb6e461dac859ee1bee15fd6', 'request_id': 'req-1145e8b3-e02e-4545-9048-b0fcf1012432'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.522339 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] The token cache is being invalidate because project 09e743b0fb6e461dac859ee1bee15fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:55.522619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.523235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-1145e8b3-e02e-4545-9048-b0fcf1012432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:55.524900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1344/2714] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:55 2022] DELETE /identity/v3/projects/09e743b0fb6e461dac859ee1bee15fd6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:55.530249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.530741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.530876 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.549778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:55.550975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:55.611023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1371/2715] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:55.619849 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.620131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.620414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.639442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:55.640663 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:55.648806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1345/2716] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:55.653177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.664168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ae9ed-fb89-441d-b4da-93690e9e42f5 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.668882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.669574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.669856 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.670132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.670864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:01:55.671171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.673886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.685554 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1372/2717] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 21:01:55.690169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.699559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31371e54-cb63-4491-b6b6-a85655a94d9c None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.704741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.705424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.705708 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.705982 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.706661 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.708550 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.737381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1346/2718] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:55.741728 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.752453 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23be6-9ce6-4960-aa45-fd6f368cb02a admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.761556 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:55.815098 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.815769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.816051 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.816327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.817150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.819201 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.842772 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1373/2719] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:55 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:55.848003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.859047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703f09-4ae2-4fed-96da-7cae9c6cb7ec admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.864205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.864875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.865188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.865487 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.866435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.868060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.880365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1347/2720] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:55.884458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.896476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b617fa-c183-4866-bda3-bf28fe366827 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.903281 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5533d7a-6440-46e7-94a4-60f1c940c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.904349 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5533d7a-6440-46e7-94a4-60f1c940c49b admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.904817 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5533d7a-6440-46e7-94a4-60f1c940c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.905327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5533d7a-6440-46e7-94a4-60f1c940c49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.907100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5533d7a-6440-46e7-94a4-60f1c940c49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.910236 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5533d7a-6440-46e7-94a4-60f1c940c49b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.923764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1374/2721] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 21:01:55.927368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:55.939893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dfcaf-9588-4a23-a600-20f7bbc9e797 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:55.944677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:55.945607 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.945893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.946163 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] PATH_INFO: `/v3/projects/a18a6d8036034e87868f64957f7651c1/users/0f1b57020dd349b9b24f0960c81a7a0b/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:55.964536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18a6d8036034e87868f64957f7651c1, user_id=0f1b57020dd349b9b24f0960c81a7a0b, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:55.967162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:55.983064 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1348/2722] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:55 2022] PUT /identity/v3/projects/a18a6d8036034e87868f64957f7651c1/users/0f1b57020dd349b9b24f0960c81a7a0b/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:01:55.995395 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:55.995708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:55.995986 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.033582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] MFA Rules not processed for user `0f1b57020dd349b9b24f0960c81a7a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:56.034809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:56.120089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1375/2723] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:01:56.125901 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.187034 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:56.194121 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6aae5-6ed5-4558-9356-4b5a813ba755 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.201152 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.201821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.202105 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.202411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.204120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.206072 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.237974 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1349/2724] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:01:56 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:56.242304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.258372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253c178-dcd2-46b0-b6d7-8b95d4f18c92 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.328526 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.329279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.329778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.330259 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.331412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.334873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.361245 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1376/2725] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:01:56 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:01:56.364879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.379442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323825-eb09-4f57-801a-8b7a05234b3f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.384145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.384812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.385141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.385443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.386317 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.387926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.401208 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1350/2726] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:56.405421 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.416381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd97b-9206-44d1-ac0c-c626c5dff746 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.422319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.423430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.423716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.423995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] PATH_INFO: `/v3/projects/bad17ea49c6b412fab57d17f04e52d35/users/a668003b309f4b6b9069d5bf34db93f8/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.435655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:56.444124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad17ea49c6b412fab57d17f04e52d35, user_id=a668003b309f4b6b9069d5bf34db93f8, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.446900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.461381 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1377/2727] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:56 2022] PUT /identity/v3/projects/bad17ea49c6b412fab57d17f04e52d35/users/a668003b309f4b6b9069d5bf34db93f8/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:56.466936 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.478726 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584719a-2cc4-4210-be9f-9d247a147c74 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.544073 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a38fb-4227-4b1e-b3e9-51bcf99fe706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.544743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a38fb-4227-4b1e-b3e9-51bcf99fe706 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.545057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a38fb-4227-4b1e-b3e9-51bcf99fe706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.545513 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a38fb-4227-4b1e-b3e9-51bcf99fe706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.546390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a38fb-4227-4b1e-b3e9-51bcf99fe706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.548738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a38fb-4227-4b1e-b3e9-51bcf99fe706 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.558985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1351/2728] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:01:56.564214 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.574406 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72989-840e-4383-b0ca-fd9ebe09ffad admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.579021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.579890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.580170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.580439 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] PATH_INFO: `/v3/projects/bad17ea49c6b412fab57d17f04e52d35/users/a668003b309f4b6b9069d5bf34db93f8/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.582408 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad17ea49c6b412fab57d17f04e52d35, user_id=a668003b309f4b6b9069d5bf34db93f8, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.585077 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.595057 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1378/2729] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:01:56 2022] PUT /identity/v3/projects/bad17ea49c6b412fab57d17f04e52d35/users/a668003b309f4b6b9069d5bf34db93f8/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:56.605199 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.605495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.605778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.632632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] MFA Rules not processed for user `a668003b309f4b6b9069d5bf34db93f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:56.633898 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:56.713474 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1352/2730] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:56.724025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:56.725749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:56.789100 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17705af-ac62-4bcd-9128-25be26c9d824 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:56.792693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559eb2b-4813-42d6-b399-a85bb6ad9d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:56.793379 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559eb2b-4813-42d6-b399-a85bb6ad9d0c service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:56.793667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559eb2b-4813-42d6-b399-a85bb6ad9d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:56.793936 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559eb2b-4813-42d6-b399-a85bb6ad9d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:56.803506 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559eb2b-4813-42d6-b399-a85bb6ad9d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:56.804882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559eb2b-4813-42d6-b399-a85bb6ad9d0c service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:56.814874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1379/2731] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:57.346454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:57.396507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:57.409996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c26449-113d-4c90-b22d-40064f5ce0ae None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:57.414508 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:57.415366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:57.415678 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:57.415956 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] PATH_INFO: `/v3/users/0f1b57020dd349b9b24f0960c81a7a0b` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:57.417185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1b57020dd349b9b24f0960c81a7a0b)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:57.419101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:57.463706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1b57020dd349b9b24f0960c81a7a0b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:57.475784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1b57020dd349b9b24f0960c81a7a0b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:57.482594 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1b57020dd349b9b24f0960c81a7a0b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:57.483248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1b57020dd349b9b24f0960c81a7a0b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:57.490345 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1b57020dd349b9b24f0960c81a7a0b'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:57.496272 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1353/2732] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:57 2022] DELETE /identity/v3/users/0f1b57020dd349b9b24f0960c81a7a0b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:57.501088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:57.501404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:57.501692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:57.519853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:01:57.521094 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:57.579273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1380/2733] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:01:57.588675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:57.590070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:57.646731 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee641-0b79-40b5-8fed-5f9470420f38 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:57.650361 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:57.650994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:57.651270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:57.651539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:57.661053 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:57.662507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:57.672525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1354/2734] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:01:57.946974 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:57.948610 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:57.961675 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed9829-25a1-4ef6-8002-6ecf09e080ce None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:57.966508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:57.967380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:57.967663 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:57.967937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] PATH_INFO: `/v3/projects/a18a6d8036034e87868f64957f7651c1` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:57.970016 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18a6d8036034e87868f64957f7651c1)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:57.971947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:58.017977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18a6d8036034e87868f64957f7651c1', 'request_id': 'req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.023354 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18a6d8036034e87868f64957f7651c1', 'request_id': 'req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.029358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18a6d8036034e87868f64957f7651c1', 'request_id': 'req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.038852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:58.043087 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] The token cache is being invalidate because project a18a6d8036034e87868f64957f7651c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:58.043436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.044389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.046423 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1381/2735] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:57 2022] DELETE /identity/v3/projects/a18a6d8036034e87868f64957f7651c1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:58.050632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:58.060237 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995ee24-6339-4a02-92ef-69df0b8b7b4a service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:58.117959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:58.118750 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:58.119029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:58.119300 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] PATH_INFO: `/v3/users/a668003b309f4b6b9069d5bf34db93f8` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:58.120458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a668003b309f4b6b9069d5bf34db93f8)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:58.122478 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:58.136054 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:01:58.172675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a668003b309f4b6b9069d5bf34db93f8'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.184455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a668003b309f4b6b9069d5bf34db93f8'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.191584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a668003b309f4b6b9069d5bf34db93f8'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.192244 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a668003b309f4b6b9069d5bf34db93f8'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.199717 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a668003b309f4b6b9069d5bf34db93f8'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.206623 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1355/2736] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:01:58 2022] DELETE /identity/v3/users/a668003b309f4b6b9069d5bf34db93f8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:01:58.469347 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:01:58.470834 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:01:58.486516 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23bd8-6c2b-4fdd-8ede-c59ba67224a2 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:01:58.547105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:01:58.547966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:01:58.548243 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:01:58.548515 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] PATH_INFO: `/v3/projects/bad17ea49c6b412fab57d17f04e52d35` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:01:58.549751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad17ea49c6b412fab57d17f04e52d35)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:01:58.551689 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:01:58.598601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad17ea49c6b412fab57d17f04e52d35', 'request_id': 'req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.604001 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad17ea49c6b412fab57d17f04e52d35', 'request_id': 'req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.610248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad17ea49c6b412fab57d17f04e52d35', 'request_id': 'req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.622405 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] The token cache is being invalidate because project bad17ea49c6b412fab57d17f04e52d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:01:58.622676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.623291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-f9bd3e5e-ae35-44d9-abf0-337b805f63f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:01:58.625386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1382/2737] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:01:58 2022] DELETE /identity/v3/projects/bad17ea49c6b412fab57d17f04e52d35 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:02:08.202514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:08.619377 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:28.272959 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:02:28.274366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:28.330471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59435c19-f951-4c52-8e2d-9c831984f4db admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:02:28.382056 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:02:28.382698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:28.382975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:28.383243 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:28.385057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:28.442158 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:02:28.443593 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdff55-b335-4695-8a48-2312e4da44fd service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:02:28.453030 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1356/2738] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:02:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:02:34.211206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:34.211713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:34.211836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:34.229303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] MFA Rules not processed for user `261feb03a8ff459b8874232bec05034f`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:02:34.230502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:34.238309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1383/2739] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:02:35.152489 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:35.153065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:35.153206 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:35.171951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] MFA Rules not processed for user `0e12538a6dd44bdd963e9850c24c04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:02:35.173209 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:35.229150 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1357/2740] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:02:35.948148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:02:35.949763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:36.019328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1ebc-228d-4468-89dc-220aae262635 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:02:36.024252 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:02:36.024902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:36.025220 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:36.025499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:36.027237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:36.038426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:02:36.039997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb006adc-784c-43cc-905d-b5e1989acb14 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:02:36.049941 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1384/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:02:45.221973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=93 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:46.045734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=35 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:51.380665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:02:51.382098 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:51.440525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dcb88-b358-4387-8c42-9fa84705375d None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:02:51.444027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:02:51.444664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:51.444963 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:51.445241 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:51.446968 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:51.507778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:02:51.509251 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:02:51.519752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1358/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:03:01.515062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=50 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:37.268748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:37.269279 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:37.269388 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:37.287277 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] MFA Rules not processed for user `0e12538a6dd44bdd963e9850c24c04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:03:37.288480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:03:37.296296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1385/2743] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:03:47.282128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:20.936473 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:20.946387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c71828-b491-4b7e-9964-c50a35ff8980 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:20.950828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:20.951752 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:20.952037 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:20.952319 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:20.954267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:21.029366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:21.030846 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:21.044142 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1359/2744] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:04:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:04:22.225449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:22.235650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbe38e-2ae2-4462-b62a-b0d20a361508 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:22.239151 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:22.239784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:22.240069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:22.240345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:22.242130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:22.256284 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:22.257766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:22.269360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1386/2745] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:04:31.037552 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=34 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:32.264345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:33.414254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:33.417008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:33.429730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298327-b43f-4680-b28d-c4a00fddeeeb service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:33.437805 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:33.438903 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:33.439625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:33.440463 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:33.442309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:33.523143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:33.525544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:33.537425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1360/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:04:40.325635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:40.328117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:40.344919 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b60e1-a385-433a-886f-b53cfb297218 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:40.350367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:40.351479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:40.352989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:40.353456 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] PATH_INFO: `/v3/users/261feb03a8ff459b8874232bec05034f` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:40.354905 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=261feb03a8ff459b8874232bec05034f)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:40.357105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:40.422227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261feb03a8ff459b8874232bec05034f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.436789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261feb03a8ff459b8874232bec05034f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.443875 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261feb03a8ff459b8874232bec05034f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.444617 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261feb03a8ff459b8874232bec05034f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.454248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261feb03a8ff459b8874232bec05034f'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.466115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1387/2747] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:04:40 2022] DELETE /identity/v3/users/261feb03a8ff459b8874232bec05034f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:04:40.688776 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:40.699006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a7d3-20cd-4d7c-9174-f192bc89b286 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:40.774458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:40.775465 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:40.775749 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:40.776043 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] PATH_INFO: `/v3/projects/6c9a3d56f8b84eb2a057425afbf79079` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:40.777547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9a3d56f8b84eb2a057425afbf79079)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:40.779627 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:40.844631 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9a3d56f8b84eb2a057425afbf79079', 'request_id': 'req-98349def-7ece-49dd-a987-644e5a57f106'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.850643 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9a3d56f8b84eb2a057425afbf79079', 'request_id': 'req-98349def-7ece-49dd-a987-644e5a57f106'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.859912 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9a3d56f8b84eb2a057425afbf79079', 'request_id': 'req-98349def-7ece-49dd-a987-644e5a57f106'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.872688 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] The token cache is being invalidate because project 6c9a3d56f8b84eb2a057425afbf79079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:04:40.873009 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.873812 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:40.875364 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1361/2748] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:04:40 2022] DELETE /identity/v3/projects/6c9a3d56f8b84eb2a057425afbf79079 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:04:40.879721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:40.881757 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:40.899486 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1cf28-6d3f-4db8-8d72-a899d9368aab admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:40.970813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:40.971696 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:40.972032 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:40.972261 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] PATH_INFO: `/v3/users/7d7e12f1b5b942249a481ee82e7045fe` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:40.973532 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7e12f1b5b942249a481ee82e7045fe)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:40.975495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:41.026582 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7e12f1b5b942249a481ee82e7045fe'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.040139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7e12f1b5b942249a481ee82e7045fe'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.047069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7e12f1b5b942249a481ee82e7045fe'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.047812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7e12f1b5b942249a481ee82e7045fe'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.049520 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:41.058166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8ab52a58-ce76-407f-982e-a3d6f702a40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7e12f1b5b942249a481ee82e7045fe'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.065485 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1388/2749] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:04:40 2022] DELETE /identity/v3/users/7d7e12f1b5b942249a481ee82e7045fe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:04:41.242923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:41.244025 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:41.257029 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98349def-7ece-49dd-a987-644e5a57f106 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:41.279346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:41.321655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:41.323008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:41.323008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:41.323232 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] PATH_INFO: `/v3/projects/5274bd07a0f244578a90b725fe87c94e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:41.324333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5274bd07a0f244578a90b725fe87c94e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:41.326922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:41.379374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5274bd07a0f244578a90b725fe87c94e', 'request_id': 'req-2636c023-5f0a-4212-b7f0-4a148d983064'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.385596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5274bd07a0f244578a90b725fe87c94e', 'request_id': 'req-2636c023-5f0a-4212-b7f0-4a148d983064'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.394014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5274bd07a0f244578a90b725fe87c94e', 'request_id': 'req-2636c023-5f0a-4212-b7f0-4a148d983064'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.405992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] The token cache is being invalidate because project 5274bd07a0f244578a90b725fe87c94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:04:41.406350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.406915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:04:41.408461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1362/2750] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:04:41 2022] DELETE /identity/v3/projects/5274bd07a0f244578a90b725fe87c94e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:04:41.801983 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:41.802468 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:41.802591 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:41.820519 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] MFA Rules not processed for user `0e12538a6dd44bdd963e9850c24c04bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:04:41.821790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:41.876601 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1389/2751] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:04:42.488429 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:42.489854 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:42.564913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636c023-5f0a-4212-b7f0-4a148d983064 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:42.569973 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:42.571187 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:42.571471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:42.571744 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:42.573576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:42.584948 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:42.586572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:42.596454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1363/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:04:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:04:46.259397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:04:46.260869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:46.317649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9dc08-37c0-402b-bff7-0798f57888bd None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:04:46.321921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:04:46.322564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:04:46.322846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:04:46.323122 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:04:46.324962 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:04:46.334334 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:04:46.335749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:04:46.343778 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1390/2753] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:04:52.592234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:04:56.340174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=53 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:43.841191 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:43.842636 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:44.000883 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82eccec-1905-43fd-947d-a3f2e6a9db37 service placement] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:44.007089 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:44.007992 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:44.008441 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:44.008878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:44.013746 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:44.033434 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:44.036257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:44.071624 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1364/2754] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:05:52.244860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:52.247175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:52.315066 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f48b11-5bab-4595-b0ee-d94879ab7b67 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:52.319599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:52.320471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:52.320753 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:52.321056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] PATH_INFO: `/v3/users/0e12538a6dd44bdd963e9850c24c04bc` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:52.322861 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e12538a6dd44bdd963e9850c24c04bc)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:52.324890 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:52.383622 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e12538a6dd44bdd963e9850c24c04bc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.397991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e12538a6dd44bdd963e9850c24c04bc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.405239 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e12538a6dd44bdd963e9850c24c04bc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.405980 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e12538a6dd44bdd963e9850c24c04bc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.414084 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-24933a86-c1d0-449f-8297-7cb98f127a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e12538a6dd44bdd963e9850c24c04bc'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.420509 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1391/2755] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:05:52 2022] DELETE /identity/v3/users/0e12538a6dd44bdd963e9850c24c04bc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:52.596709 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:52.608762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c74c10-d07f-4e74-848b-1e87bf61a1e5 service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:52.667915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:52.668774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:52.669104 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:52.669381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] PATH_INFO: `/v3/projects/e74557ea7f0f4057b190c0adaaa80ed9` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:52.670551 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74557ea7f0f4057b190c0adaaa80ed9)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:52.672454 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:52.719008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74557ea7f0f4057b190c0adaaa80ed9', 'request_id': 'req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.724406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74557ea7f0f4057b190c0adaaa80ed9', 'request_id': 'req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.731902 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74557ea7f0f4057b190c0adaaa80ed9', 'request_id': 'req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.742724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] The token cache is being invalidate because project e74557ea7f0f4057b190c0adaaa80ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:05:52.743010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.743635 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2ac5f2b0-511c-43c1-9e1b-3346d614d1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:52.745336 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1365/2756] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:05:52 2022] DELETE /identity/v3/projects/e74557ea7f0f4057b190c0adaaa80ed9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:52.750335 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:52.750632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:52.750915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:52.769787 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:52.770991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:52.833536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1392/2757] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:52.841715 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:52.841933 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:52.842213 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:52.861000 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:52.862205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:52.870786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1366/2758] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:52.875157 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:52.884991 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b2d6-b003-4874-bd74-ab3bcef1cca7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:52.889699 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:52.890364 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:52.890916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:52.891199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:52.891960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:05:52.892269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:52.893948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:52.907269 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1393/2759] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:05:52.911539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:52.921641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4caea-d973-4cd6-ad4b-28b891915f51 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:52.926337 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:52.926993 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:52.927280 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:52.927555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:52.928297 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:52.930236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:52.935020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:52.958496 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1367/2760] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:05:52 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:52.962599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:52.974484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fd5a9-9c86-4f8b-b4c9-8bdceaec6ab6 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:52.978184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:53.032685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.033415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.033700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.033976 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.034655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.036598 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.055579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1394/2761] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:05:52 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:53.060304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.070424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9397e-f1df-4812-8b97-b8b0959a550c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.075671 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.076323 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.076606 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.076881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.077638 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.079283 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.090499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1368/2762] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:53.094435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.104811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133c493-f289-4eda-801b-c764748518a4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.109435 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff010ed-4da9-43fa-ba1a-f56f9a8f416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.110099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff010ed-4da9-43fa-ba1a-f56f9a8f416e admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.110361 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff010ed-4da9-43fa-ba1a-f56f9a8f416e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.110635 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff010ed-4da9-43fa-ba1a-f56f9a8f416e admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.111350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff010ed-4da9-43fa-ba1a-f56f9a8f416e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.112982 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff010ed-4da9-43fa-ba1a-f56f9a8f416e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.122845 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1395/2763] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:53.127004 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.137897 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590c01c-e599-46bf-9b51-9e15ae95f073 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.143630 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.144507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.144784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.145087 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] PATH_INFO: `/v3/projects/365b4a3e921847f991625cf7dbf899e9/users/88e06629178d41c69b0bf725240f36f6/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.160312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=365b4a3e921847f991625cf7dbf899e9, user_id=88e06629178d41c69b0bf725240f36f6, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.163060 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.176395 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1369/2764] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:05:53 2022] PUT /identity/v3/projects/365b4a3e921847f991625cf7dbf899e9/users/88e06629178d41c69b0bf725240f36f6/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:53.186718 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.187116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.187400 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.213735 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] MFA Rules not processed for user `88e06629178d41c69b0bf725240f36f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:53.214798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:53.276713 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1396/2765] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:53.281134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.342240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb3bc2-dcd6-4bae-8498-7ca096398fae admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.346862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.347447 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.347729 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.348003 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.348675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.350595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.376634 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1370/2766] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:05:53 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:53.380667 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.391896 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603e962-3407-417b-a4ed-26f005a65b02 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.448427 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.449127 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.449415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.449694 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.450389 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.452323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.471614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1397/2767] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:05:53 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:53.475626 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.487301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75248d-1f8b-4a46-82ad-d132c007c869 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.491861 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.492515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.492799 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.493109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.493827 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.496444 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.506995 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1371/2768] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:53.511203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.517854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:53.521907 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad97545-3342-4980-a951-c3b4e5065ebb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.528358 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b4a6d-1e39-4717-bd80-15293763b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.529059 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b4a6d-1e39-4717-bd80-15293763b847 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.529344 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b4a6d-1e39-4717-bd80-15293763b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.529620 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b4a6d-1e39-4717-bd80-15293763b847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.530338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b4a6d-1e39-4717-bd80-15293763b847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.531920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b4a6d-1e39-4717-bd80-15293763b847 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.542337 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1398/2769] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:53.546619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.556724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d247-63ea-4fe0-9529-b963d53fa139 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.561629 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.562510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.562802 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.563078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] PATH_INFO: `/v3/projects/a950a86cf195400dafad7e0b7c28105e/users/099b1d4866484bf894304b5a0d8719d7/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.578184 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a950a86cf195400dafad7e0b7c28105e, user_id=099b1d4866484bf894304b5a0d8719d7, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.580872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.593842 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1372/2770] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:05:53 2022] PUT /identity/v3/projects/a950a86cf195400dafad7e0b7c28105e/users/099b1d4866484bf894304b5a0d8719d7/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:53.605227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.605451 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.605727 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.632132 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] MFA Rules not processed for user `099b1d4866484bf894304b5a0d8719d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:53.633359 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:53.695776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1399/2771] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:53.700608 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.763906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c420ee-9f63-4b96-b11d-631cdedab94c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.768832 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.769517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.769797 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.770069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.770761 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.772670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.777010 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:53.799899 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1373/2772] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:05:53 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:53.804086 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.815639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee960c0-b0b6-4a59-a9b4-55d83f8af8ae None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.871374 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.871972 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.872260 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.872540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.873262 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.875203 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.896853 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1400/2773] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:05:53 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:53.901062 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.911333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221102bf-fd25-4fba-9897-146ab996b056 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.915932 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.916586 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.916864 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.917169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.917884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.919471 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.929853 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1374/2774] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:53.934545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.944458 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd5685-3842-413d-b1d4-13a0e723b81e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:53.949937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:53.950811 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:53.951093 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:53.951368 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] PATH_INFO: `/v3/projects/b95ba611bb7a47f19bf8be9ef5f20836/users/c3b8aa58b86546c39817dd5a95372e83/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:53.965686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95ba611bb7a47f19bf8be9ef5f20836, user_id=c3b8aa58b86546c39817dd5a95372e83, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:53.968327 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:53.981605 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1401/2775] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:05:53 2022] PUT /identity/v3/projects/b95ba611bb7a47f19bf8be9ef5f20836/users/c3b8aa58b86546c39817dd5a95372e83/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:53.985735 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:53.996721 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2030f93-ca0c-4a1c-a3ad-98b39f0c1ac3 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:54.057114 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ce64-00b2-41b8-9b2e-768774402498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:54.057817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ce64-00b2-41b8-9b2e-768774402498 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:54.058101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ce64-00b2-41b8-9b2e-768774402498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:54.058375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ce64-00b2-41b8-9b2e-768774402498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:54.059097 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ce64-00b2-41b8-9b2e-768774402498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:54.060698 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29ce64-00b2-41b8-9b2e-768774402498 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:54.070346 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1375/2776] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:54.074659 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:54.084790 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d555cc9-f3b5-4657-9dfe-8c27a5a52178 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:54.089924 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:54.090794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:54.091070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:54.091367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] PATH_INFO: `/v3/projects/b95ba611bb7a47f19bf8be9ef5f20836/users/c3b8aa58b86546c39817dd5a95372e83/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:54.093350 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95ba611bb7a47f19bf8be9ef5f20836, user_id=c3b8aa58b86546c39817dd5a95372e83, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:54.095967 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:54.106619 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1402/2777] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:05:54 2022] PUT /identity/v3/projects/b95ba611bb7a47f19bf8be9ef5f20836/users/c3b8aa58b86546c39817dd5a95372e83/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:54.116322 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:54.116612 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:54.116889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:54.143535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] MFA Rules not processed for user `c3b8aa58b86546c39817dd5a95372e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:54.144664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:54.212665 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1376/2778] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:54.223702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:54.225409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:54.268014 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:54.286542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638733b-ec88-4ff5-a94c-6024358e1504 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:54.290315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:54.291508 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:54.291795 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:54.292067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:54.300952 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:54.302386 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:54.312812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1403/2779] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:05:54.350642 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:54.352018 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:54.364598 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac7897-0e4d-44d9-b2b2-e9dfe657dc60 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:54.368149 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64651950-ea66-476d-812e-3712df60e11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:54.368783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64651950-ea66-476d-812e-3712df60e11d service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:54.370632 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64651950-ea66-476d-812e-3712df60e11d service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:54.370917 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64651950-ea66-476d-812e-3712df60e11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:54.425460 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:54.427687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64651950-ea66-476d-812e-3712df60e11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:54.429485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64651950-ea66-476d-812e-3712df60e11d service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:54.439666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1377/2780] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:05:57.281914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:57.348163 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dce76-a642-4044-9b6a-68352794a71b service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:57.352770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:57.353708 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:57.353998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:57.354271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] PATH_INFO: `/v3/users/88e06629178d41c69b0bf725240f36f6` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:57.355460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e06629178d41c69b0bf725240f36f6)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:57.357431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:57.403908 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e06629178d41c69b0bf725240f36f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.415898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e06629178d41c69b0bf725240f36f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.422912 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e06629178d41c69b0bf725240f36f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.423574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e06629178d41c69b0bf725240f36f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.432197 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e06629178d41c69b0bf725240f36f6'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.441371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1404/2781] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:05:57 2022] DELETE /identity/v3/users/88e06629178d41c69b0bf725240f36f6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:57.443192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:57.443714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:57.443714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:57.461574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:57.462794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:57.521384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1378/2782] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:57.531096 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:57.532517 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:57.598442 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f055-ea0a-442b-bbc2-b5adc705b303 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:57.602117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:57.602760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:57.603045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:57.603550 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:57.613766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:57.615200 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:57.620854 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:57.625977 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1405/2783] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:05:57.891865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:57.893390 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:57.906891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbd455-be1f-40ec-a5b9-02dafbabacbe None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:57.911558 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:57.912424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:57.912707 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:57.913124 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] PATH_INFO: `/v3/projects/365b4a3e921847f991625cf7dbf899e9` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:57.914306 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=365b4a3e921847f991625cf7dbf899e9)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:57.916411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:57.962548 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365b4a3e921847f991625cf7dbf899e9', 'request_id': 'req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.968102 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365b4a3e921847f991625cf7dbf899e9', 'request_id': 'req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.975795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365b4a3e921847f991625cf7dbf899e9', 'request_id': 'req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.990267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] The token cache is being invalidate because project 365b4a3e921847f991625cf7dbf899e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:05:57.990556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.991193 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:57.992734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1379/2784] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:05:57 2022] DELETE /identity/v3/projects/365b4a3e921847f991625cf7dbf899e9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:57.997614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:58.007167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1ba3-4311-4628-882f-2945dc1a6e77 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:58.062492 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:58.063362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:58.063647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:58.063925 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] PATH_INFO: `/v3/users/099b1d4866484bf894304b5a0d8719d7` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:58.065145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099b1d4866484bf894304b5a0d8719d7)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:58.067067 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:58.113296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099b1d4866484bf894304b5a0d8719d7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.126119 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099b1d4866484bf894304b5a0d8719d7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.132878 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099b1d4866484bf894304b5a0d8719d7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.133579 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099b1d4866484bf894304b5a0d8719d7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.141160 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099b1d4866484bf894304b5a0d8719d7'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.146947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1406/2785] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:05:57 2022] DELETE /identity/v3/users/099b1d4866484bf894304b5a0d8719d7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:58.418238 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:58.419886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:58.437507 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bd3e0-6ed7-4490-8e02-e6706c0ffcfc admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:58.495588 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:58.496410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:58.496689 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:58.496986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] PATH_INFO: `/v3/projects/a950a86cf195400dafad7e0b7c28105e` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:58.498202 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a950a86cf195400dafad7e0b7c28105e)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:58.500113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:58.523007 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:58.549065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a950a86cf195400dafad7e0b7c28105e', 'request_id': 'req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.554455 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a950a86cf195400dafad7e0b7c28105e', 'request_id': 'req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.564685 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a950a86cf195400dafad7e0b7c28105e', 'request_id': 'req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.577794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] The token cache is being invalidate because project a950a86cf195400dafad7e0b7c28105e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:05:58.578081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.578727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.580284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1380/2786] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:05:58 2022] DELETE /identity/v3/projects/a950a86cf195400dafad7e0b7c28105e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:58.584372 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:58.585997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:58.599871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a682-fb6e-4b06-8a3f-3d945f325064 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:58.656530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:58.657433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:58.657720 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:58.657996 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] PATH_INFO: `/v3/users/c3b8aa58b86546c39817dd5a95372e83` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:58.659181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b8aa58b86546c39817dd5a95372e83)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:58.661139 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:58.683825 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:58.710881 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b8aa58b86546c39817dd5a95372e83'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.728829 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b8aa58b86546c39817dd5a95372e83'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.736287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b8aa58b86546c39817dd5a95372e83'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.737040 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b8aa58b86546c39817dd5a95372e83'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.745479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-04a5957d-7f91-4e87-9bf0-0032dcacca45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b8aa58b86546c39817dd5a95372e83'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:58.753860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1407/2787] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:05:58 2022] DELETE /identity/v3/users/c3b8aa58b86546c39817dd5a95372e83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:59.096795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.099210 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:59.116055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee3f5-55e1-49e1-8a68-ce0f4211195c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.178109 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.178987 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.179267 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.179535 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] PATH_INFO: `/v3/projects/b95ba611bb7a47f19bf8be9ef5f20836` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.180727 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95ba611bb7a47f19bf8be9ef5f20836)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.182836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.242503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95ba611bb7a47f19bf8be9ef5f20836', 'request_id': 'req-5c085edb-5aec-4cbb-8d33-faee096caaee'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:59.249730 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95ba611bb7a47f19bf8be9ef5f20836', 'request_id': 'req-5c085edb-5aec-4cbb-8d33-faee096caaee'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:59.264138 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95ba611bb7a47f19bf8be9ef5f20836', 'request_id': 'req-5c085edb-5aec-4cbb-8d33-faee096caaee'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:59.277205 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] The token cache is being invalidate because project b95ba611bb7a47f19bf8be9ef5f20836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:05:59.277499 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:59.278379 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5c085edb-5aec-4cbb-8d33-faee096caaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:05:59.280275 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1381/2788] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:05:59 2022] DELETE /identity/v3/projects/b95ba611bb7a47f19bf8be9ef5f20836 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:05:59.290290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.290658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.291042 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.314493 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:59.316565 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:59.392937 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1408/2789] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:59.403658 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.403975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.404516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.424786 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:59.426320 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:59.436141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1382/2790] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:59.441476 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.452602 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d263ce4-347e-484b-9891-4b3e7b2a6881 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.458037 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.458211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.458706 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.459211 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.460068 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:05:59.460393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.462849 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.477121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1409/2791] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:05:59.482348 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.492622 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2390e53-c60c-4711-a428-c531f2b34ef1 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.498647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.499362 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.499641 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.499916 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.500599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.502561 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.528492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1383/2792] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:05:59 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:05:59.532686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.543426 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3eb2-a336-46a9-8858-8c26e939d465 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.601083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.601766 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.602028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.602306 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.602987 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.605481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.624656 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1410/2793] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:05:59 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:05:59.628810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.639084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42041e-dc25-45df-bb0d-09d93e953c1f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.643944 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.644597 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.644878 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.645182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.645932 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.647524 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.652782 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:59.659595 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1384/2794] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:59.663608 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.674213 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d853-9f84-4a3f-8408-0785a32ff886 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.678840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe4090-b427-417c-8b9e-f2a7931631d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.679495 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4090-b427-417c-8b9e-f2a7931631d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.679776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4090-b427-417c-8b9e-f2a7931631d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.680054 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4090-b427-417c-8b9e-f2a7931631d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.680809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe4090-b427-417c-8b9e-f2a7931631d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.683015 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe4090-b427-417c-8b9e-f2a7931631d5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.692975 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1411/2795] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:05:59.697543 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.707432 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bfec4-85c0-49e9-9925-6ccac14c3131 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.712100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.713525 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.713900 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.714179 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] PATH_INFO: `/v3/projects/6bcc3c3f7c4243c1932a4b097a0d8e69/users/434899354cf64c7c88c9b32d0d311ac5/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.729023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcc3c3f7c4243c1932a4b097a0d8e69, user_id=434899354cf64c7c88c9b32d0d311ac5, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.731762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.745108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1385/2796] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:05:59 2022] PUT /identity/v3/projects/6bcc3c3f7c4243c1932a4b097a0d8e69/users/434899354cf64c7c88c9b32d0d311ac5/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:05:59.757205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.757498 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.757776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.766144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:05:59.786462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] MFA Rules not processed for user `434899354cf64c7c88c9b32d0d311ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:05:59.787697 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:59.857839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1412/2797] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:05:59.889068 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:05:59.891040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:05:59.954949 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e81bd-3d68-456d-aaf0-b8f90975c67b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:05:59.959196 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f5ab-d407-4813-898b-ff57584ea5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:05:59.959852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f5ab-d407-4813-898b-ff57584ea5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:05:59.960132 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f5ab-d407-4813-898b-ff57584ea5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:05:59.960407 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f5ab-d407-4813-898b-ff57584ea5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:05:59.969495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f5ab-d407-4813-898b-ff57584ea5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:05:59.970923 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f5ab-d407-4813-898b-ff57584ea5b2 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:05:59.980311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1386/2798] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:05:59.994693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:00.055472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f13a-b12d-45a4-807e-06df9138cbb3 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:00.060662 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:00.061557 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.061840 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.062116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] PATH_INFO: `/v3/users/434899354cf64c7c88c9b32d0d311ac5` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.063303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434899354cf64c7c88c9b32d0d311ac5)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:00.065433 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:00.111128 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434899354cf64c7c88c9b32d0d311ac5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.122537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434899354cf64c7c88c9b32d0d311ac5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.129150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434899354cf64c7c88c9b32d0d311ac5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.129798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434899354cf64c7c88c9b32d0d311ac5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.137869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434899354cf64c7c88c9b32d0d311ac5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.144009 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1413/2799] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:05:59 2022] DELETE /identity/v3/users/434899354cf64c7c88c9b32d0d311ac5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:00.148530 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.148824 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.149134 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.167082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:00.168273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:00.226229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1387/2800] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:00.236503 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:00.237943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:00.252271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:00.297559 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e80cb-269c-4926-ba8d-afa702f93ac8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:00.301295 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b3dc0-04ac-4d1e-bbec-ffc7fd44a033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:00.301947 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b3dc0-04ac-4d1e-bbec-ffc7fd44a033 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.302232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b3dc0-04ac-4d1e-bbec-ffc7fd44a033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.302511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b3dc0-04ac-4d1e-bbec-ffc7fd44a033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.312174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b3dc0-04ac-4d1e-bbec-ffc7fd44a033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:00.313645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b3dc0-04ac-4d1e-bbec-ffc7fd44a033 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:00.323514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1414/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:00.596522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:00.598008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:00.610758 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497ccc-b980-4a75-8496-38d2c69ad74a None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:00.615308 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:00.616165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.616442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.616712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] PATH_INFO: `/v3/projects/6bcc3c3f7c4243c1932a4b097a0d8e69` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.618050 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcc3c3f7c4243c1932a4b097a0d8e69)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:00.620059 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:00.666922 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcc3c3f7c4243c1932a4b097a0d8e69', 'request_id': 'req-e55cb091-154e-4ac3-a1ea-a8ff534960a2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.672367 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcc3c3f7c4243c1932a4b097a0d8e69', 'request_id': 'req-e55cb091-154e-4ac3-a1ea-a8ff534960a2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.679806 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcc3c3f7c4243c1932a4b097a0d8e69', 'request_id': 'req-e55cb091-154e-4ac3-a1ea-a8ff534960a2'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.691938 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] The token cache is being invalidate because project 6bcc3c3f7c4243c1932a4b097a0d8e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:06:00.692221 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.692866 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-e55cb091-154e-4ac3-a1ea-a8ff534960a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:00.694419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1388/2802] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:06:00 2022] DELETE /identity/v3/projects/6bcc3c3f7c4243c1932a4b097a0d8e69 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:06:00.699385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.699867 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.699970 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.723202 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:00.724765 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:00.788803 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1415/2803] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:00.797240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.797532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.797813 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.804101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:00.818370 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:00.819596 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:00.829316 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1389/2804] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:00.833522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:00.843945 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe254-8e01-43fc-b555-a9a3b63725e1 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:00.848637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:00.849332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.849618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.849898 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.850661 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:06:00.850971 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:00.852614 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:00.864915 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1416/2805] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:06:00.869038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:00.878562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b89071-4913-49a3-9d83-1af5626c0a21 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:00.883309 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:00.884169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.884479 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.885406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.886096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:00.887986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:00.913381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1390/2806] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:06:00 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:06:00.917789 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:00.928004 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8810e2-ab26-4df7-8377-f872f4527fd4 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:00.986226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:00.986893 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:00.987176 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:00.987449 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:00.988137 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:00.990124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:01.009109 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1417/2807] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:06:00 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:06:01.013911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:01.024332 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421d9b7-6a48-4786-94cd-51fc0c9a856d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:01.029517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:01.030164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:01.030442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:01.030714 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:01.031426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:01.033038 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:01.043512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1391/2808] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:01.047404 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:01.059484 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46514-9812-4898-abf5-fcaa0b513c18 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:01.064367 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ecd2e-fdd0-491d-b642-82f2cf0a08eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:01.065061 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ecd2e-fdd0-491d-b642-82f2cf0a08eb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:01.065345 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ecd2e-fdd0-491d-b642-82f2cf0a08eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:01.065631 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ecd2e-fdd0-491d-b642-82f2cf0a08eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:01.066338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ecd2e-fdd0-491d-b642-82f2cf0a08eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:01.067966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ecd2e-fdd0-491d-b642-82f2cf0a08eb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:01.079237 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1418/2809] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:01.083384 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:01.094040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ebfaa-1b0f-4ff8-a4a0-d0b73afd3efe admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:01.099066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:01.099990 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:01.100279 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:01.100559 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] PATH_INFO: `/v3/projects/dcbcbfb2b856474e8ea464a74b1923fc/users/49a60878710e4b2f8d3430aa37227447/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:01.115287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbcbfb2b856474e8ea464a74b1923fc, user_id=49a60878710e4b2f8d3430aa37227447, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:01.118020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:01.130343 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1392/2810] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:06:01 2022] PUT /identity/v3/projects/dcbcbfb2b856474e8ea464a74b1923fc/users/49a60878710e4b2f8d3430aa37227447/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:01.141380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:01.141676 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:01.141960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:01.168997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] MFA Rules not processed for user `49a60878710e4b2f8d3430aa37227447`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:01.170130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:01.179193 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:01.234314 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1419/2811] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:01.245655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:01.247333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:01.302964 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b5d90-3401-42d2-8af8-81cb06856a7a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:01.306614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114ac0e-2e15-4c57-83c0-522eea80bc96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:01.307250 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ac0e-2e15-4c57-83c0-522eea80bc96 service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:01.307533 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ac0e-2e15-4c57-83c0-522eea80bc96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:01.307821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114ac0e-2e15-4c57-83c0-522eea80bc96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:01.315994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114ac0e-2e15-4c57-83c0-522eea80bc96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:01.317458 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114ac0e-2e15-4c57-83c0-522eea80bc96 service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:01.326061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1393/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:11.231401 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=22 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:11.322699 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:18.779871 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:18.842752 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96555b-febf-4dcf-aafe-e1b0fdcb2a51 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:18.847223 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:18.848089 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:18.848363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:18.848632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] PATH_INFO: `/v3/users/49a60878710e4b2f8d3430aa37227447` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:18.849858 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a60878710e4b2f8d3430aa37227447)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:18.851784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:18.899437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a60878710e4b2f8d3430aa37227447'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:18.911839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a60878710e4b2f8d3430aa37227447'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:18.918577 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a60878710e4b2f8d3430aa37227447'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:18.919246 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a60878710e4b2f8d3430aa37227447'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:18.926396 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a60878710e4b2f8d3430aa37227447'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:18.932311 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1420/2813] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:06:18 2022] DELETE /identity/v3/users/49a60878710e4b2f8d3430aa37227447 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:18.936893 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:18.937406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:18.937536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:18.955078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:18.956254 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:19.012977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1394/2814] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:19.023010 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.024410 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:19.082625 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e795c-489b-4656-9627-e7ebe7f7f1fc admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.086309 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a6152-f053-4995-b1a2-f0251ad8a10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.086950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6152-f053-4995-b1a2-f0251ad8a10b service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.087235 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6152-f053-4995-b1a2-f0251ad8a10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.087514 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a6152-f053-4995-b1a2-f0251ad8a10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.096889 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6152-f053-4995-b1a2-f0251ad8a10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.098355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a6152-f053-4995-b1a2-f0251ad8a10b service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.109249 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1421/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:19.377091 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.378574 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:19.390784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7478f-1b52-4de5-aed9-dc4b4e74f3fb None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.395759 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.396637 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.396920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.397236 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] PATH_INFO: `/v3/projects/dcbcbfb2b856474e8ea464a74b1923fc` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.398502 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbcbfb2b856474e8ea464a74b1923fc)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.401276 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.451510 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbcbfb2b856474e8ea464a74b1923fc', 'request_id': 'req-cb5c0f08-e340-408f-9b88-b0df25f77d53'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:19.456889 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbcbfb2b856474e8ea464a74b1923fc', 'request_id': 'req-cb5c0f08-e340-408f-9b88-b0df25f77d53'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:19.464022 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbcbfb2b856474e8ea464a74b1923fc', 'request_id': 'req-cb5c0f08-e340-408f-9b88-b0df25f77d53'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:19.475078 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] The token cache is being invalidate because project dcbcbfb2b856474e8ea464a74b1923fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:06:19.475387 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:19.476006 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-cb5c0f08-e340-408f-9b88-b0df25f77d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:19.477571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1395/2816] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:06:19 2022] DELETE /identity/v3/projects/dcbcbfb2b856474e8ea464a74b1923fc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:19.482886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.483181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.483460 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.501749 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:19.502951 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:19.519807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:19.563371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1422/2817] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:19.622108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.622391 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.622667 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.641466 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:19.642651 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:19.650969 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1396/2818] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:19.654998 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.664647 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf260cc-4eb4-4010-836d-d2f461c98699 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.669341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.669990 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.670270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.670540 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.671303 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:06:19.671666 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.673292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.684848 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1423/2819] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:06:19.688895 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.698691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75bd64-4786-4564-8033-ca25d29b1384 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.703334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.703977 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.704259 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.704532 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.705287 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.707284 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.735359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1397/2820] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:06:19 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:19.736496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.746409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48280f-7ce5-407e-8507-fe5a37c67f37 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.802739 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.803437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.803693 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.803963 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.804651 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.806646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.827002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1424/2821] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:06:19 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:19.830905 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.841724 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471935b4-b269-481e-a964-dac66efd8e07 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.846445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.847090 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.847375 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.847655 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.848381 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.850020 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.860539 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1398/2822] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:19.864462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.874745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c60b-6ee2-4985-bb47-6e95218b2cc7 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.879412 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23a592-72ca-4018-8f3c-125b04f0e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.880065 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23a592-72ca-4018-8f3c-125b04f0e4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.880352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23a592-72ca-4018-8f3c-125b04f0e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.880630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23a592-72ca-4018-8f3c-125b04f0e4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.881397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23a592-72ca-4018-8f3c-125b04f0e4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.883005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23a592-72ca-4018-8f3c-125b04f0e4d6 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.893921 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1425/2823] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:19.898040 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:19.908411 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014a31e-a1e7-4a89-a286-5ef1ee1b4b7b admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:19.912957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:19.914042 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.914334 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.914609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] PATH_INFO: `/v3/projects/2a9671965677473e872420bd618dec93/users/a82f374ab6b941979b35ab9e045345fa/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.929157 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9671965677473e872420bd618dec93, user_id=a82f374ab6b941979b35ab9e045345fa, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:19.932005 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:19.944741 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1399/2824] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:06:19 2022] PUT /identity/v3/projects/2a9671965677473e872420bd618dec93/users/a82f374ab6b941979b35ab9e045345fa/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:19.955244 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:19.955534 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:19.955839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:19.982448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] MFA Rules not processed for user `a82f374ab6b941979b35ab9e045345fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:19.983564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:20.045609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1426/2825] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:20.050170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.071512 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:20.116437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cb273-4c52-4cd8-884f-aadf228db0a4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.122609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.123534 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.124027 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.124519 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.125807 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.128394 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.154621 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1400/2826] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:20.158851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.169813 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae7f7-8ae2-4701-9949-26e12325f47c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.182296 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:20.227370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.228038 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.228418 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.228646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.229391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.231362 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.251491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1427/2827] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:06:20 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:20.255366 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.266660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5392-9a64-4ed3-bec0-dba864142121 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.271329 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.271985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.272270 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.272547 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.273304 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.274911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.285611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1401/2828] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:20.289618 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.299564 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf656-d525-4b07-886a-8d567e088d93 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.304118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd1daa-b3e1-41d4-b9e3-008e1a239e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.304763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1daa-b3e1-41d4-b9e3-008e1a239e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.305076 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1daa-b3e1-41d4-b9e3-008e1a239e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.305357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd1daa-b3e1-41d4-b9e3-008e1a239e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.306072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1daa-b3e1-41d4-b9e3-008e1a239e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.308341 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd1daa-b3e1-41d4-b9e3-008e1a239e20 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.318290 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1428/2829] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:20.323382 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.333647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730010c-d671-48b9-a11c-1adc89bd0858 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.338515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.339398 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.339679 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.339951 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] PATH_INFO: `/v3/projects/7a9d67c657ab4faabe896911639a2537/users/97b7bd4a51724ddcb0b939abab9d56b0/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.354625 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9d67c657ab4faabe896911639a2537, user_id=97b7bd4a51724ddcb0b939abab9d56b0, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.357293 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.369930 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1402/2830] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:06:20 2022] PUT /identity/v3/projects/7a9d67c657ab4faabe896911639a2537/users/97b7bd4a51724ddcb0b939abab9d56b0/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:06:20.379943 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.380232 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.380511 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.407225 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] MFA Rules not processed for user `97b7bd4a51724ddcb0b939abab9d56b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:20.408445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:20.470969 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1429/2831] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:06:20.475522 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.536886 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457043f0-253d-4859-be08-9d1a5c99234d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.542019 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.542664 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.542945 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.543220 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.543984 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.545881 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.570388 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1403/2832] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:06:20 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:20.574571 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.585019 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd602dc-dc5a-45d4-b9f1-f163c6183bae None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.639700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.640360 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.640641 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.640916 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.641888 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.643807 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.663080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1430/2833] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:06:20 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:20.667331 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.677571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac0679-ab05-4438-af6e-430cd40b2e8f admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.682484 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.683141 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.683427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.683705 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.684418 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.686057 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.696369 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1404/2834] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:20.700769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.710852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4b643-a77d-48b9-9044-1440913bcbdb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.716338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.717248 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.717533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.717812 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] PATH_INFO: `/v3/projects/3564e51f2a0b4e5c9937e1036b352617/users/1f01d731b8c649ca90d43c9b659ce5ac/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.729722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:20.733153 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3564e51f2a0b4e5c9937e1036b352617, user_id=1f01d731b8c649ca90d43c9b659ce5ac, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.736600 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.749931 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1431/2835] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:06:20 2022] PUT /identity/v3/projects/3564e51f2a0b4e5c9937e1036b352617/users/1f01d731b8c649ca90d43c9b659ce5ac/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:20.753764 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.764045 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a618e3-798c-4aec-895e-4f8a69f529b8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.806101 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:20.824071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84730474-c2e2-486d-b8cc-9b3c7ec74791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.824743 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730474-c2e2-486d-b8cc-9b3c7ec74791 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.825065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730474-c2e2-486d-b8cc-9b3c7ec74791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.825347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730474-c2e2-486d-b8cc-9b3c7ec74791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.826070 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730474-c2e2-486d-b8cc-9b3c7ec74791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.827687 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730474-c2e2-486d-b8cc-9b3c7ec74791 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.837433 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1405/2836] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:20.841808 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.852070 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56858-5887-4a78-a753-8dcf412f8499 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:20.857356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:20.858233 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.858512 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.858784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] PATH_INFO: `/v3/projects/3564e51f2a0b4e5c9937e1036b352617/users/1f01d731b8c649ca90d43c9b659ce5ac/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.860750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3564e51f2a0b4e5c9937e1036b352617, user_id=1f01d731b8c649ca90d43c9b659ce5ac, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:20.863411 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:20.874522 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1432/2837] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:06:20 2022] PUT /identity/v3/projects/3564e51f2a0b4e5c9937e1036b352617/users/1f01d731b8c649ca90d43c9b659ce5ac/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:20.885757 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:20.886052 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:20.886335 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:20.913351 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] MFA Rules not processed for user `1f01d731b8c649ca90d43c9b659ce5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:20.914554 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:20.982061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1406/2838] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:20.993257 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:20.994966 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:21.051746 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1566d8-9f6b-4997-aace-dd4ecad75270 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:21.055286 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:21.055914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:21.056196 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:21.056482 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:21.110454 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:21.111882 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:21.120552 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1433/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:22.595734 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:22.597162 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:22.609576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d08ca-fba7-453e-84bc-ba4896c3578f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:22.613108 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:22.613762 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:22.614041 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:22.614310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:22.670732 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:22.672125 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:22.680857 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1407/2840] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:23.201121 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:23.209902 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5998f3-529d-4f7c-b428-2e2ed18ee4d3 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:23.214251 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1008e-ee79-40cb-afc0-ae7a508fb7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:23.214901 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1008e-ee79-40cb-afc0-ae7a508fb7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:23.215182 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1008e-ee79-40cb-afc0-ae7a508fb7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:23.215455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1008e-ee79-40cb-afc0-ae7a508fb7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:23.224542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1008e-ee79-40cb-afc0-ae7a508fb7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:23.226025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1008e-ee79-40cb-afc0-ae7a508fb7c4 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:23.236135 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1434/2841] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:27.047852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:27.109295 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4c10b-c9a6-4eed-90f2-85fef1e20b8b service cinder] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:27.114084 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:27.114955 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:27.115240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:27.115517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] PATH_INFO: `/v3/users/a82f374ab6b941979b35ab9e045345fa` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:27.116696 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82f374ab6b941979b35ab9e045345fa)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:27.118662 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:27.124071 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=100 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:27.165613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82f374ab6b941979b35ab9e045345fa'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.179991 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82f374ab6b941979b35ab9e045345fa'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.186793 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82f374ab6b941979b35ab9e045345fa'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.187442 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82f374ab6b941979b35ab9e045345fa'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.194879 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82f374ab6b941979b35ab9e045345fa'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.202327 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1408/2842] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:06:27 2022] DELETE /identity/v3/users/a82f374ab6b941979b35ab9e045345fa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:27.206847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:27.207371 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:27.207478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:27.226798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:27.227997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:27.285453 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1435/2843] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:27.295143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:27.296580 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:27.354181 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d085d3-3139-4674-bce7-eed15bc944bd admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:27.357872 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:27.358514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:27.358796 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:27.359069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:27.367952 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:27.369555 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:27.378873 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1409/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:27.643866 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:27.645415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:27.659716 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d042d-1287-41ce-bce6-35a6f15d2492 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:27.664448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:27.665353 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:27.665637 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:27.666118 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] PATH_INFO: `/v3/projects/2a9671965677473e872420bd618dec93` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:27.667452 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9671965677473e872420bd618dec93)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:27.669319 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:27.686167 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:27.717596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9671965677473e872420bd618dec93', 'request_id': 'req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.723148 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9671965677473e872420bd618dec93', 'request_id': 'req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.729217 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9671965677473e872420bd618dec93', 'request_id': 'req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.741325 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] The token cache is being invalidate because project 2a9671965677473e872420bd618dec93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:06:27.741609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.742218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.743734 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1436/2845] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:06:27 2022] DELETE /identity/v3/projects/2a9671965677473e872420bd618dec93 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:27.748266 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:27.758074 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe90e6-4356-44c2-83ba-d37732dcb623 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:27.815492 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:27.816377 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:27.816660 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:27.816957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] PATH_INFO: `/v3/users/97b7bd4a51724ddcb0b939abab9d56b0` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:27.818165 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b7bd4a51724ddcb0b939abab9d56b0)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:27.820015 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:27.847822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:27.866046 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b7bd4a51724ddcb0b939abab9d56b0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.877676 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b7bd4a51724ddcb0b939abab9d56b0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.885188 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b7bd4a51724ddcb0b939abab9d56b0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.885915 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b7bd4a51724ddcb0b939abab9d56b0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.893503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b7bd4a51724ddcb0b939abab9d56b0'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:27.899517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1410/2846] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:06:27 2022] DELETE /identity/v3/users/97b7bd4a51724ddcb0b939abab9d56b0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:28.166415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:28.167948 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:28.181332 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230bf48-9e8a-4ec9-b4f7-0dcbb4e153e5 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:28.240206 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:28.241117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:28.241403 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:28.241679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] PATH_INFO: `/v3/projects/7a9d67c657ab4faabe896911639a2537` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:28.242841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9d67c657ab4faabe896911639a2537)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:28.245392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:28.292227 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9d67c657ab4faabe896911639a2537', 'request_id': 'req-8dca56a1-075d-411f-a1e4-4e683082750e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.297784 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9d67c657ab4faabe896911639a2537', 'request_id': 'req-8dca56a1-075d-411f-a1e4-4e683082750e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.303769 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9d67c657ab4faabe896911639a2537', 'request_id': 'req-8dca56a1-075d-411f-a1e4-4e683082750e'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.316544 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] The token cache is being invalidate because project 7a9d67c657ab4faabe896911639a2537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:06:28.316832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.317488 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.319080 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1437/2847] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:06:28 2022] DELETE /identity/v3/projects/7a9d67c657ab4faabe896911639a2537 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:28.323935 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:28.325485 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:28.338428 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeaf4d-059a-4910-bf1e-d1ae291020f8 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:28.394859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:28.394859 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:28.395119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:28.395386 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] PATH_INFO: `/v3/users/1f01d731b8c649ca90d43c9b659ce5ac` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:28.396562 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f01d731b8c649ca90d43c9b659ce5ac)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:28.398517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:28.443461 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f01d731b8c649ca90d43c9b659ce5ac'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.455100 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f01d731b8c649ca90d43c9b659ce5ac'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.461855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f01d731b8c649ca90d43c9b659ce5ac'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.462515 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f01d731b8c649ca90d43c9b659ce5ac'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.470669 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-5f7bc0d1-7cab-4d2f-8c84-884c1383c72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f01d731b8c649ca90d43c9b659ce5ac'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.476693 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1411/2848] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:06:28 2022] DELETE /identity/v3/users/1f01d731b8c649ca90d43c9b659ce5ac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:06:28.751012 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:28.752561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:28.767028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca56a1-075d-411f-a1e4-4e683082750e admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:28.801380 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:28.830052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:28.830920 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:28.831205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:28.831481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] PATH_INFO: `/v3/projects/3564e51f2a0b4e5c9937e1036b352617` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:28.832669 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3564e51f2a0b4e5c9937e1036b352617)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:28.834634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:28.879814 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3564e51f2a0b4e5c9937e1036b352617', 'request_id': 'req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.885585 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3564e51f2a0b4e5c9937e1036b352617', 'request_id': 'req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.891864 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3564e51f2a0b4e5c9937e1036b352617', 'request_id': 'req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.904690 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] The token cache is being invalidate because project 3564e51f2a0b4e5c9937e1036b352617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:06:28.905005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.905650 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-207f7ebc-c1cc-476b-8b18-4acfbcf59e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:06:28.907166 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1438/2849] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:06:28 2022] DELETE /identity/v3/projects/3564e51f2a0b4e5c9937e1036b352617 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:28.912128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:28.912424 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:28.912719 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:28.932081 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:28.933273 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:28.951448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:28.992578 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1412/2850] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:29.001072 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.001370 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.001654 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.019852 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:29.021115 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:29.029794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1439/2851] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:29.033985 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.044127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d174b-6b28-442f-8a21-eb79ec85bcd7 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.048957 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.049619 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.049907 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.050185 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.050911 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:06:29.051219 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.052871 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.065240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1413/2852] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:06:29.069531 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.079291 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3353b-34f6-48bf-b0ec-18769522461a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.083851 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.084490 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.084797 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.085102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.085806 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.087750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.112430 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1440/2853] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:06:29 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:29.116385 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.127666 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a338e7a-500f-4a28-bb31-203067d380a4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.186503 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.187143 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.187423 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.187700 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] PATH_INFO: `/v3/users` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.188410 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.190368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.210248 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1414/2854] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:06:29 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:06:29.214537 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.225008 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767ac38-447e-4ce3-b2ff-517153c15e04 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.233431 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.234117 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.234402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.234679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.235583 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.237832 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.250465 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1441/2855] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:29.254435 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.265706 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e914-837c-4103-8241-d27fabb5cd3a admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.270573 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dd89e-474e-45eb-a6c9-7965bcddfc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.271233 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dd89e-474e-45eb-a6c9-7965bcddfc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.271516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dd89e-474e-45eb-a6c9-7965bcddfc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.271792 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dd89e-474e-45eb-a6c9-7965bcddfc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.272517 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dd89e-474e-45eb-a6c9-7965bcddfc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.274169 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dd89e-474e-45eb-a6c9-7965bcddfc78 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.285214 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1415/2856] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:06:29.289299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.300273 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee585f-54ae-4ceb-97dc-4a9d3f2321c1 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.304954 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.305846 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.306130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.306997 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] PATH_INFO: `/v3/projects/c4a4d189a97b441ea2790d04daa79853/users/9538a349ca91455f818e1b9d7758f400/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.321352 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a4d189a97b441ea2790d04daa79853, user_id=9538a349ca91455f818e1b9d7758f400, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.324528 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.337208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1442/2857] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:06:29 2022] PUT /identity/v3/projects/c4a4d189a97b441ea2790d04daa79853/users/9538a349ca91455f818e1b9d7758f400/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:06:29.343260 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e99f-1733-4131-9096-6c2d595bdbc0 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.343756 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e99f-1733-4131-9096-6c2d595bdbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.343862 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e99f-1733-4131-9096-6c2d595bdbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.362790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-f356e99f-1733-4131-9096-6c2d595bdbc0 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:29.363999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-f356e99f-1733-4131-9096-6c2d595bdbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:29.423997 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1416/2858] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:29.434181 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:29.436002 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:29.495779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1ed61-b176-4efd-a4ad-cbf44ad55094 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:29.499471 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:29.500126 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:29.500409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:29.500686 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:29.510186 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:29.511630 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:29.521391 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1443/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:30.159111 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e82ef-a473-4e2e-8bcb-51128015321f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:30.159403 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e82ef-a473-4e2e-8bcb-51128015321f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:30.159681 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e82ef-a473-4e2e-8bcb-51128015321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:30.187354 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-d11e82ef-a473-4e2e-8bcb-51128015321f None None] MFA Rules not processed for user `9538a349ca91455f818e1b9d7758f400`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:30.188670 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d11e82ef-a473-4e2e-8bcb-51128015321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:30.209970 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:30.262514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1417/2860] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:30.273494 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:30.274964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:30.282581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:30.334502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2039a4e-3f54-4d54-908c-bbb9a2f74549 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:30.338674 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a4d556adeb43139a65f61af0076091', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:30.339316 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:30.339596 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:30.339869 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:30.348658 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:30.350124 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:30.359171 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1444/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:31.692777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:31.693368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:31.693368 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:31.711406 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] MFA Rules not processed for user `9538a349ca91455f818e1b9d7758f400`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:06:31.712653 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:31.720399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1418/2862] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:06:31.965670 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:31.967104 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:31.979205 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7514f9-5749-4b7c-9d10-5f805aeb7eb0 service cinder] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:31.982821 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:31.983455 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:31.983744 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:31.984022 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:31.985770 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:31.995721 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:31.997177 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd5215-a48e-4bc6-9e70-089d052ebf52 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:32.005226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1445/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:39.724599 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:06:39.726389 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:39.805014 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad34ba3-3ddf-4177-ac52-095b8692d93f None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:06:39.811128 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434f65-440d-4519-b06c-628086761935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:06:39.811784 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434f65-440d-4519-b06c-628086761935 service nova] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:06:39.812069 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434f65-440d-4519-b06c-628086761935 service nova] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:06:39.812347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c434f65-440d-4519-b06c-628086761935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:06:39.814120 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-4c434f65-440d-4519-b06c-628086761935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:06:39.826644 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c434f65-440d-4519-b06c-628086761935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:06:39.828245 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c434f65-440d-4519-b06c-628086761935 service nova] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:06:39.838865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1419/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:06:42.001599 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=31 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:06:49.834347 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=55 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:29.468886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:29.469437 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:29.469566 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:29.495589 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] MFA Rules not processed for user `9538a349ca91455f818e1b9d7758f400`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:07:29.496767 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:29.519929 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1446/2865] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:07:29.748821 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434f65-440d-4519-b06c-628086761935 service nova] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:29.789026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c434f65-440d-4519-b06c-628086761935 service nova] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:29.793516 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:29.794161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:29.794448 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:29.794728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:29.796523 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:29.818437 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:29.819888 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:29.828170 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1420/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:07:39.517645 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=15 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:39.824413 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=23 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:59.826692 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:59.828192 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:59.926794 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914a13-ba93-440e-af18-b7d0299c771a None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:59.933099 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:59.933761 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:59.934045 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:59.934323 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:59.936116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:59.948900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:59.950536 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:59.961742 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1447/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:07:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:08:09.957175 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=44 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:22.530546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.532008 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:22.547180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02490c-20f3-45e8-8ece-c1a47559dc95 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:22.552182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:22.552845 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.553164 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.553443 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.555940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:22.568691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:22.570452 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:22.582960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1421/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:08:22.589445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.624491 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3dd3-7f21-4429-8c47-d09806320013 service placement] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:22.629199 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:22.630039 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.630294 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.630570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] PATH_INFO: `/v3/users/9538a349ca91455f818e1b9d7758f400` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.631760 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9538a349ca91455f818e1b9d7758f400)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:22.634271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:22.680049 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9538a349ca91455f818e1b9d7758f400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:22.692184 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9538a349ca91455f818e1b9d7758f400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:22.699634 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9538a349ca91455f818e1b9d7758f400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:22.700299 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9538a349ca91455f818e1b9d7758f400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:22.708434 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-19a3030a-a65a-4857-aa96-4de30b94fc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9538a349ca91455f818e1b9d7758f400'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:22.715035 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1448/2869] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:08:22 2022] DELETE /identity/v3/users/9538a349ca91455f818e1b9d7758f400 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:22.888728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:22.902855 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d4eb8-e510-4336-9cf3-0602e6351cfb service placement] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:22.960024 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:22.960880 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:22.961190 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:22.962129 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] PATH_INFO: `/v3/projects/c4a4d189a97b441ea2790d04daa79853` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:22.963412 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a4d189a97b441ea2790d04daa79853)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:22.965536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.013885 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a4d189a97b441ea2790d04daa79853', 'request_id': 'req-daa003c5-349d-44b2-ac2a-b09af2a31a82'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:23.019509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a4d189a97b441ea2790d04daa79853', 'request_id': 'req-daa003c5-349d-44b2-ac2a-b09af2a31a82'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:23.027235 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a4d189a97b441ea2790d04daa79853', 'request_id': 'req-daa003c5-349d-44b2-ac2a-b09af2a31a82'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:23.050026 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] The token cache is being invalidate because project c4a4d189a97b441ea2790d04daa79853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:08:23.050312 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:23.050931 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-daa003c5-349d-44b2-ac2a-b09af2a31a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:08:23.052459 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1422/2870] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:08:22 2022] DELETE /identity/v3/projects/c4a4d189a97b441ea2790d04daa79853 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:23.058208 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.058502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.058786 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.114338 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:23.115570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:23.176762 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1449/2871] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:23.184659 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.184975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.185257 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.203151 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:23.204350 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:23.212875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1423/2872] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:23.217995 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.231809 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074e7df-1dde-4079-8ce2-6403e1c92632 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.236472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.237162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.237448 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.237726 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.238462 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 21:08:23.238773 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.240375 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.252655 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1450/2873] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 21:08:23.257065 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.271393 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f58e-71d9-44cd-8f34-18754e7c3539 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.276672 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.277544 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.277823 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.278092 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.278774 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.280703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.306601 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1424/2874] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:23.310779 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.320801 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964535-753e-44dd-bf33-b9f58d2195fb admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.329695 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.378150 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.378810 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.379091 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.379363 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.380036 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.381988 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.401574 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1451/2875] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:23.405567 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.416365 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ddc88-aa90-44e5-9ca6-db0a19c9d09d admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.420865 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.421541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.421822 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.422094 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.422838 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.424425 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.436023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1425/2876] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:08:23.439874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.450064 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec4e36-206b-4895-b9fd-d55c513fc7d8 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.454748 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c89d0-25b9-44a8-9c8c-67d0d4e03ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.455397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c89d0-25b9-44a8-9c8c-67d0d4e03ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.455682 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c89d0-25b9-44a8-9c8c-67d0d4e03ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.455960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c89d0-25b9-44a8-9c8c-67d0d4e03ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.456688 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c89d0-25b9-44a8-9c8c-67d0d4e03ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.458328 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c89d0-25b9-44a8-9c8c-67d0d4e03ae3 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.468551 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1452/2877] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:08:23.472495 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.482929 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2ed9-3cc7-4a2e-a60f-15cceb1743cb admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.487571 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.488445 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.488728 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.489032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] PATH_INFO: `/v3/projects/0fd0a48966e24e63a11fc4ee42a10330/users/8170a0af23d94859adea5840424c4d70/roles/792cfc3478734abe8d0b3462c9e2a065` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.627940 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd0a48966e24e63a11fc4ee42a10330, user_id=8170a0af23d94859adea5840424c4d70, role_id=792cfc3478734abe8d0b3462c9e2a065)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.630614 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.643794 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1426/2878] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:08:23 2022] PUT /identity/v3/projects/0fd0a48966e24e63a11fc4ee42a10330/users/8170a0af23d94859adea5840424c4d70/roles/792cfc3478734abe8d0b3462c9e2a065 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 21:08:23.649116 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fc50d-b7f7-4ca4-b179-3f08b63d741b None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.650105 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fc50d-b7f7-4ca4-b179-3f08b63d741b None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.650535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fc50d-b7f7-4ca4-b179-3f08b63d741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.668058 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-123fc50d-b7f7-4ca4-b179-3f08b63d741b None None] MFA Rules not processed for user `52d40fe0347f4d97acf889a2462a0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:23.669224 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-123fc50d-b7f7-4ca4-b179-3f08b63d741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:23.728702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1453/2879] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:23.738509 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:23.740229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:23.746083 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:23.800333 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8dc0c-663e-48ad-ad33-ad358d723c75 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:23.803960 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:23.804600 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:23.804884 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:23.805192 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:23.814677 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:23.816096 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:23.825913 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1427/2880] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:08:28.036628 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.037163 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.037270 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.065841 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] MFA Rules not processed for user `8170a0af23d94859adea5840424c4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:28.067062 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:28.136638 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1454/2881] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:28.141234 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.151777 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bed60-6049-45d6-bcce-4cbfdbaf2315 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.156422 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.157119 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.157401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.157675 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] PATH_INFO: `/v3/projects` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.158427 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.160269 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.187572 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1428/2882] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 5 21:08:28 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 21:08:28.191569 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.203415 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ab4c-ec7b-479b-9d24-ce010750e7e7 None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.222149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:28.262393 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.263069 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.263356 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.263639 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] PATH_INFO: `/v3/users` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.264333 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.266292 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.286533 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1455/2883] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 5 21:08:28 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 21:08:28.290647 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.300920 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1536e-351f-41ed-9a15-f27ea8f5e34c admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.306023 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.306765 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.307049 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.307326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.308075 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.309722 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.319908 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1429/2884] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:08:28.324664 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.334677 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999821d-c54d-4ede-a966-9b1b812eb48d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.339446 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.340324 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.340722 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.341056 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] PATH_INFO: `/v3/projects/d0d07e1d45e94fc78bbeab872775bb26/users/0fdc1a03a52247ce938984fc9453bc0d/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.355573 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d07e1d45e94fc78bbeab872775bb26, user_id=0fdc1a03a52247ce938984fc9453bc0d, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.358287 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.371282 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1456/2885] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:08:28 2022] PUT /identity/v3/projects/d0d07e1d45e94fc78bbeab872775bb26/users/0fdc1a03a52247ce938984fc9453bc0d/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:28.375296 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.386942 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2d7e0-cf70-4cd4-8a16-5d5125307a49 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.443541 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaccdf-7e1f-4f17-903c-f22b10e9479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.444131 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaccdf-7e1f-4f17-903c-f22b10e9479f admin admin] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.444419 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaccdf-7e1f-4f17-903c-f22b10e9479f admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.444691 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaccdf-7e1f-4f17-903c-f22b10e9479f admin admin] PATH_INFO: `/v3/roles` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.445450 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaccdf-7e1f-4f17-903c-f22b10e9479f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.447674 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaccdf-7e1f-4f17-903c-f22b10e9479f admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.457399 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1430/2886] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 5 21:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 21:08:28.462145 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:28.476028 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd069-0e74-44a8-a47b-9a0ab3a0f068 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:28.482560 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:28.483445 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] REQUEST_METHOD: `PUT` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:28.483729 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:28.484007 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] PATH_INFO: `/v3/projects/d0d07e1d45e94fc78bbeab872775bb26/users/0fdc1a03a52247ce938984fc9453bc0d/roles/a570a4bfca4f44058b14bbbabd43dd0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:28.486088 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d07e1d45e94fc78bbeab872775bb26, user_id=0fdc1a03a52247ce938984fc9453bc0d, role_id=a570a4bfca4f44058b14bbbabd43dd0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:28.488738 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:28.499168 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1457/2887] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 5 21:08:28 2022] PUT /identity/v3/projects/d0d07e1d45e94fc78bbeab872775bb26/users/0fdc1a03a52247ce938984fc9453bc0d/roles/a570a4bfca4f44058b14bbbabd43dd0d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:08:32.747310 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afe329-7bd0-4ad1-9798-4ab1468fbbff None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:32.747896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afe329-7bd0-4ad1-9798-4ab1468fbbff None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:32.747896 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afe329-7bd0-4ad1-9798-4ab1468fbbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:32.790836 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-90afe329-7bd0-4ad1-9798-4ab1468fbbff None None] MFA Rules not processed for user `0fdc1a03a52247ce938984fc9453bc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:32.792047 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-90afe329-7bd0-4ad1-9798-4ab1468fbbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:32.875431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:32.905720 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1431/2888] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:32.913860 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:32.919083 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:33.016547 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae6fcc-8eb4-491c-9418-dde6ec34b81d admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.022025 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbd8ecdcc21f4d22b969036c1d7a3672', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.022700 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.023191 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.023472 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.091732 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.093909 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.106501 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1458/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:08:33.239264 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbf750-038c-4fd8-a4db-9bfd087f32e2 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.239400 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbf750-038c-4fd8-a4db-9bfd087f32e2 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.239650 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbf750-038c-4fd8-a4db-9bfd087f32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.325986 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-a0bbf750-038c-4fd8-a4db-9bfd087f32e2 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:33.327216 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a0bbf750-038c-4fd8-a4db-9bfd087f32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:33.411321 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1432/2890] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:33.460204 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:33.462170 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:33.497741 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:33.561136 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ae14f-2080-41e2-a9b9-878cb9977396 service glance] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:33.566826 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb9ab3-e4b7-4d8e-b25a-f3aff361ca2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:33.567480 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb9ab3-e4b7-4d8e-b25a-f3aff361ca2f service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:33.567763 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb9ab3-e4b7-4d8e-b25a-f3aff361ca2f service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:33.568043 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb9ab3-e4b7-4d8e-b25a-f3aff361ca2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:33.578685 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb9ab3-e4b7-4d8e-b25a-f3aff361ca2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:33.580397 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb9ab3-e4b7-4d8e-b25a-f3aff361ca2f service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:33.590632 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1459/2891] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:08:42.122066 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:42.122639 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:42.122745 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:42.140431 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] MFA Rules not processed for user `8170a0af23d94859adea5840424c4d70`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:42.141652 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:42.148616 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1433/2892] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 5 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:08:43.585886 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=28 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:43.926776 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] REQUEST_METHOD: `POST` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.927075 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.927357 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:43.946771 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.auth.core [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:08:43.949102 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:08:43.956847 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1460/2893] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 5 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 21:08:43.970117 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:08:43.985240 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d4765-209e-4802-a203-baeb15fc2dd1 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:08:43.990359 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:08:43.991082 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:08:43.991426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:08:43.991703 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:08:44.001417 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:08:44.002996 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:08:44.012426 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1434/2894] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:08:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 21:08:53.941147 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=3 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:08:54.008055 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=59 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:10.561621 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:10.616052 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b27ef-2ecb-4bc7-9692-2cc5a1670b9c None None] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:10.620629 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:10.621315 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:10.621597 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:10.621873 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:10.630731 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:10.632162 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:10.642561 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1461/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:09:20.638496 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=26 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:37.181712 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:37.191355 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed067740-4c41-4e0b-ba57-a40d639a1370 service swift] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:37.194975 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:37.195611 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:37.195891 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:37.196180 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:37.198176 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:37.290810 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:37.292249 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:37.314795 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1435/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:09:38.571842 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:09:38.580535 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef186-81fa-4906-b71c-a55b5efa347f service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:09:38.584071 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:09:38.584702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:09:38.585021 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:09:38.585298 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:09:38.587530 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:09:38.600443 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:09:38.601918 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:09:38.613751 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1462/2897] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:09:47.312217 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=43 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:09:48.608955 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=6 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:26.910783 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:26.926613 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b89887-2ea9-4977-8d29-de3856fa0a91 service neutron] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:26.937584 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aef7668f15405b8d665fe61e6a49c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:26.939557 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:26.941514 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:26.943439 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:26.948875 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:26.969826 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:26.972145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411a55-4a9e-4f73-844c-dc998cc3fd5e service neutron] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:26.985738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1436/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:10:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:10:27.971730 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:27.974479 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:27.988701 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e4a20-e934-4d1c-b798-e63118f40ec4 service neutron] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:27.996247 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '624366e88245426a8837e3ce0b714531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:27.996914 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:27.997226 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:27.997570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:27.999387 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:28.013874 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:28.015478 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:28.028594 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1463/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:10:34.158301 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] REQUEST_METHOD: `POST` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.158778 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.158994 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.177817 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.auth.core [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] MFA Rules not processed for user `71519a4d3c414dd88bad0afdf727a521`. Rule list: `[]` (Enabled: `True`). {{(pid=80151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 21:10:34.178999 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:34.186538 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1437/2900] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 5 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 21:10:34.226964 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:34.238409 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ebd4-8d94-43b8-88b7-2b15b1ccf7ca service nova] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:34.243392 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56392bbbf8e449cfbcdddd6a492444bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:34.244023 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:34.244304 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:34.244609 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:34.252545 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:34.254165 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:34.262679 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1464/2901] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 5 21:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 21:10:40.818798 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.820268 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:40.885110 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:40.920326 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efe26c-f5ba-43e3-b621-67e0cc3d5b81 None None] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.925414 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.926061 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] REQUEST_METHOD: `GET` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.926338 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.926609 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.928363 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:40.944536 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.947033 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:40.959103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b94db-f9d8-4edf-8667-d1c493706e33 service swift] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:40.960401 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1438/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:10:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:10:40.964788 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:40.965702 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:40.965989 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:40.966271 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] PATH_INFO: `/v3/users/8170a0af23d94859adea5840424c4d70` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:40.967481 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8170a0af23d94859adea5840424c4d70)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:40.969436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.023719 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8170a0af23d94859adea5840424c4d70'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.036649 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8170a0af23d94859adea5840424c4d70'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.044218 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8170a0af23d94859adea5840424c4d70'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.045005 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8170a0af23d94859adea5840424c4d70'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.052402 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8170a0af23d94859adea5840424c4d70'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.058798 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1465/2903] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:10:40 2022] DELETE /identity/v3/users/8170a0af23d94859adea5840424c4d70 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:41.242549 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.253971 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2d2bd-5efc-4bb8-a9d0-7cedf03a5104 service placement] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.310684 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.311546 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.311828 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.312113 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] PATH_INFO: `/v3/projects/0fd0a48966e24e63a11fc4ee42a10330` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.313324 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd0a48966e24e63a11fc4ee42a10330)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.315229 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.360587 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd0a48966e24e63a11fc4ee42a10330', 'request_id': 'req-614cd42a-ef36-46cd-ac63-c39bc1508ad4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.366032 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd0a48966e24e63a11fc4ee42a10330', 'request_id': 'req-614cd42a-ef36-46cd-ac63-c39bc1508ad4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.373556 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd0a48966e24e63a11fc4ee42a10330', 'request_id': 'req-614cd42a-ef36-46cd-ac63-c39bc1508ad4'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.381197 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.385890 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] The token cache is being invalidate because project 0fd0a48966e24e63a11fc4ee42a10330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:10:41.386374 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.387408 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.389127 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1439/2904] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:10:41 2022] DELETE /identity/v3/projects/0fd0a48966e24e63a11fc4ee42a10330 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:41.393130 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.394764 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:41.408745 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e996c-8a44-488c-a110-9bc836217939 admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.456131 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:41.466950 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.467815 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.468103 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.468378 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] PATH_INFO: `/v3/users/0fdc1a03a52247ce938984fc9453bc0d` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.469581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdc1a03a52247ce938984fc9453bc0d)` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.471499 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.517385 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdc1a03a52247ce938984fc9453bc0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.530355 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdc1a03a52247ce938984fc9453bc0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.537174 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdc1a03a52247ce938984fc9453bc0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.537839 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdc1a03a52247ce938984fc9453bc0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.546581 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.notifications [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdc1a03a52247ce938984fc9453bc0d'} {{(pid=80152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.552646 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1466/2905] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 5 21:10:41 2022] DELETE /identity/v3/users/0fdc1a03a52247ce938984fc9453bc0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:41.728145 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Authenticating user token {{(pid=80151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:10:41.729603 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.fernet_utils [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:10:41.742231 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd42a-ef36-46cd-ac63-c39bc1508ad4 admin admin] Validating token access rules against request {{(pid=80151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:10:41.799906 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52d40fe0347f4d97acf889a2462a0c46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc03931f4286458d988d48dd2cd6c224', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:10:41.800790 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:10:41.801161 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:10:41.801576 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] PATH_INFO: `/v3/projects/d0d07e1d45e94fc78bbeab872775bb26` {{(pid=80151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:10:41.802852 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d07e1d45e94fc78bbeab872775bb26)` {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:10:41.804738 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] RBAC: Authorization granted {{(pid=80151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:10:41.850926 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d07e1d45e94fc78bbeab872775bb26', 'request_id': 'req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.857311 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d07e1d45e94fc78bbeab872775bb26', 'request_id': 'req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.865106 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d07e1d45e94fc78bbeab872775bb26', 'request_id': 'req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d'} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.876870 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] The token cache is being invalidate because project d0d07e1d45e94fc78bbeab872775bb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:10:41.877182 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.877811 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG keystone.notifications [None req-ddc48d57-6d13-4d15-8c3b-d5ef77c60b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:10:41.879330 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: [pid: 80151|app: 0|req: 1440/2906] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 5 21:10:41 2022] DELETE /identity/v3/projects/d0d07e1d45e94fc78bbeab872775bb26 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:10:51.548900 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:10:51.873850 dv-cinder-797608-49-iscsi devstack@keystone.service[80151]: DEBUG dbcounter [-] [80151] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:13:35.469343 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Authenticating user token {{(pid=80152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:13:35.470750 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:35.541960 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce281e-115c-4d1a-9912-de4d671b279b admin admin] Validating token access rules against request {{(pid=80152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:13:35.602502 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3acb6587f284491ea5854898abfbc4fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd789fcfd78754c508c8b9b828d354534', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:13:35.603149 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] REQUEST_METHOD: `GET` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:13:35.603436 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:13:35.603714 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:13:35.605836 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.fernet_utils [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:13:35.617570 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:13:35.619144 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c91756-0ae1-4f83-9621-6ea03fc3e9e8 service placement] RBAC: Authorization granted {{(pid=80152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:13:35.629542 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: [pid: 80152|app: 0|req: 1467/2907] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 5 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:13:45.624715 dv-cinder-797608-49-iscsi devstack@keystone.service[80152]: DEBUG dbcounter [-] [80152] Writing DB stats keystone:SELECT=58 {{(pid=80152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}